-- Logs begin at Wed 2021-10-27 13:21:23 UTC, end at Wed 2021-10-27 14:27:41 UTC. -- Oct 27 13:53:48.574151 dv-cinder-815663-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 27 13:53:48.584933 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 13:53:48 2021] *** Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: nodename: dv-cinder-815663-1-iscsi Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: machine: x86_64 Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: clock source: unix Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: pcre jit disabled Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: detected number of CPU cores: 4 Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: current working directory: / Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: detected binary path: /usr/bin/uwsgi-core Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: your processes number limit is 47680 Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: your memory page size is 4096 bytes Oct 27 13:53:48.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: detected max file descriptor number: 2048 Oct 27 13:53:48.587715 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: lock engine: pthread robust mutexes Oct 27 13:53:48.587715 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: thunder lock: enabled Oct 27 13:53:48.587715 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 27 13:53:48.587715 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 13:53:48.627498 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: Python main interpreter initialized at 0x55884a4ec9c0 Oct 27 13:53:48.627498 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: python threads support enabled Oct 27 13:53:48.627498 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: your server socket listen backlog is limited to 100 connections Oct 27 13:53:48.627498 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: your mercy for graceful operations on workers is 90 seconds Oct 27 13:53:48.627883 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 13:53:48.627883 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: *** Operational MODE: preforking *** Oct 27 13:53:48.628168 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: *** uWSGI is running in multiple interpreter mode *** Oct 27 13:53:48.628168 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: spawned uWSGI master process (pid: 66080) Oct 27 13:53:48.628379 dv-cinder-815663-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 27 13:53:48.630659 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: spawned uWSGI worker 1 (pid: 66091, cores: 1) Oct 27 13:53:48.630659 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: spawned uWSGI worker 2 (pid: 66092, cores: 1) Oct 27 13:53:48.630659 dv-cinder-815663-1-iscsi devstack@keystone.service[66080]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 13:53:51.479968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:53:51.480564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:53:51.480948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:53:51.481033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:53:51.481111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] command line args: [] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:53:51.481173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] command line args: [] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:53:51.481237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:53:51.481306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:53:51.481365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ================================================================================ {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:53:51.481427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ================================================================================ {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:53:51.481490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] admin_token = **** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.481563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] admin_token = **** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.481622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] config_dir = [] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.481683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] config_dir = [] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.481740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.481796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.481862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] config_source = [] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.481926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] config_source = [] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.481988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] debug = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.482051 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] debug = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.482108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.482510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.482510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.482678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.482741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.482796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.482862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.482933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483194 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] list_limit = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483428 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] list_limit = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] log_config_append = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] log_config_append = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] log_dir = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.483945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] log_dir = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.484007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] log_file = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.484068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] log_file = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.484251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.484367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.484507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.484600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.484720 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.484801 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.485221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.485313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.485442 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.485528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.485733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.486302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.486383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.486525 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.486738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.486826 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.486965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.487091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.487205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.487290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.487443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.487571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.487679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.487769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.487929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.488059 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.488179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.488298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.488442 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.488557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.488938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.489044 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.489180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] publish_errors = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.489303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] publish_errors = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.489419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.489534 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.489648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.489769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.489893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.490022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.490139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.490265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.490381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.490496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.490599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] standard_threads = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.490745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] standard_threads = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.490869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.490987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.491107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.491302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.491428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.491552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.491669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] use_journal = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.491790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] use_journal = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.491905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] use_json = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.492022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] use_json = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.492136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] use_stderr = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.492259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] use_stderr = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.492376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] use_syslog = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.492492 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] use_syslog = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.492607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.492722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:53:51.492837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.492963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.493082 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.493197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.493312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.493434 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.493556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.493680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.493811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.493928 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.494043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.494166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.494282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.494406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.494528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.494667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.494786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.494901 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.495022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.495155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.495280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.495406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.495523 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.495638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.495827 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.495945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.496061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.496176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.496298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.496420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.496544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.496661 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.496782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.496898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.497013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.497134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.497261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.497385 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.497507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.497623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.497744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.497860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.497993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.498110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.498225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.498341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.498456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.498571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.498758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.498882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.498999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.499120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.499242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.499360 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.499486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.499604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.499719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.499833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.499948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.500087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.500211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.500327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.500450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.500565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.500680 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.500795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.500917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.501034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.501149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.501312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.501432 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.501572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.501805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.501932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.502049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.502165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.502165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.502381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.502509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.502647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.502766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.502882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.502998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.503113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.503241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.503359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.503474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.503591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.503706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.503821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.503945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.504061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.504176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.504291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.504406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.504529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.504647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.504762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.504877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.504991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.505106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.505229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.505345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.505460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.505580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.505697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.505813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.505936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.506052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.506167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.506282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.506396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.506511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.506638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.506745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.506852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.506951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.507047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.507143 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.507249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.507378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.507484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.507583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.507687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.507807 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.507931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.508061 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.508178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.508295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.508416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.508524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.508646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.508763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.508763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.508989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.509118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.509235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.509362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.509480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.509693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.509819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.509937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.510061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.510177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.510293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.510425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.510543 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.510698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.510824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.510932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.511047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.511171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.511288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.511404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] auth.external = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.511526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.511643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.511759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] auth.external = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.511876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.511995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.512110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.512226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.512342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] auth.password = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.512457 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.512581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] auth.token = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.512699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] auth.password = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.512814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.512930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] auth.token = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.513046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.513162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.513348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.513466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.513589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.513705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.513821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.513936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.514061 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.514178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.514293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.514409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.514530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] credential.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.514661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.514792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.514910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] credential.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.515026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.515144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.515267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.515385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.515510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.515627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.515743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.515865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.515987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.516103 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.516228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.516346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.516475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.516601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.516720 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.517402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.517530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.517639 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.517757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.517873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.517989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.518104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.518220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.518345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.518463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.518582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.518751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.518869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.518985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] federation.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.519117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.519242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.519361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] federation.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.519483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.519602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.519724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.519850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.519968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.520068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.520234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.520380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.520501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.520619 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.520742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.520873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.520997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.521115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.521232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.521350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.521468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.521597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.521717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.521834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.521950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.522073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.522175 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.522300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.522419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.522538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.522669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.522788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.522905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.523038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.523158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.523275 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.523393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.523517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.523644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.523762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.523879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.524004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.524122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.524239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.524365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.524491 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.524610 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.524727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.524844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.524962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.525087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.525206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.525323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.525439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.525557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.525658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.525782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.525900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.526017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.526135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.526252 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.526368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.526497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.526616 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.526829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.526949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.527066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.527183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.527314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.527432 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.527550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.527667 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.527768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.527883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.528077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.528198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.528316 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.528433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.528554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.528672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.528799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.528917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.529034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.529151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.529268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.529384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.529513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.529638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.529762 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.529882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.529999 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.530116 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.530242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.530360 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.530483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.530601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.530733 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.530852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.530982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.531102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.531219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.531335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.531452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.531569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.531694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.531812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.531931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.532048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.532174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.532291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.532416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.533163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.533289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.533407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.533525 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.533642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.533768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.533887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.534005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.534122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.534239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.534355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.534480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.534606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.534768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.534887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.535005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.535122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.535247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.535367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.535483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.535609 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.535727 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.535844 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.535969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.536088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.536206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.536323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.536440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.536565 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.536690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.536809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.536926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.537043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.537161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.537287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.537405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.537522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.537639 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.537755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.537872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.537997 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.538116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.538235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.538352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.538479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.538598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.538748 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.538868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.538985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.539102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.539221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.539338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.539462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.539581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.539698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.539815 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.539931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.540048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.540172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.540292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.540408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.540525 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.540641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.540758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.540884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.541003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.541120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.541237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.541355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.541472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.541597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.541721 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.541840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.541957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.542074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.542191 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.542317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.542436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.542554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.542714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.542833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.542950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.543080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.543199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.543317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.543435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.543558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.543685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.543812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.543930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] resource.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.544048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.544165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.544282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] resource.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.544399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.544525 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.544659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.544836 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.544983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.545102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.545220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.545220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.545450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.545569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.545686 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.545802 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.545918 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.546044 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.546163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.546281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] role.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.546398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.546514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] role.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.546647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.546778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.546898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] role.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.547016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.547132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] role.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.547249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.547367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.547492 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.547612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.547729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.547846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.547963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.548064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.548238 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.548358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.548475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.548593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.548715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.549004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.549126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.549244 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.549362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.549479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.549596 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.549724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.549843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.549967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.550087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.550205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.550205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.550420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.550538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.550707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.550707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.550931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.551049 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.551179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.551298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.551415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.551532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.551649 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.551766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.551958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.552079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.552196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.552313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.552430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.552547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.552673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.552791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.552909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.553026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.553143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.553260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.553385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.553504 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.553621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.553738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.553855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.553973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.554098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.554217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.554334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.554451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.554568 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.554717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.554838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.554956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] token.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.555072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.555195 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.555314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.555440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.555559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] token.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.555676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.555793 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.555911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.556029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.556154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.556273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.556390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.556507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.556673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.556790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.556915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.557034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.557151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.557267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.557384 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.557500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.557625 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.557743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.557859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.557975 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.558093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.558192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.558316 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.558435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.558551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.558693 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.558816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.558933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.559062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.559182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.559299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.connection = **** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.559416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.559533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.559649 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.559775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.559892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.connection = **** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.560009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.560125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.560243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.560359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.560484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.560602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.560719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.560835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.560953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.561069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.561194 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.561313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.561429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.561546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.561663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.561779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.561904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.562021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.562138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.562255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.562372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.562488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.562613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.562747 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.562864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.562980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.563097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.563213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.563343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.563462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.563579 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.563579 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:53:51.563843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.563843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.563843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:53:51.563843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:53:51.588541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.588766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.588986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.589090 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.589225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.589455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.599142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.599483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.628100 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.628317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.628930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.629170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.684635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.685309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.736985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.737240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.738769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.739014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.802425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.802731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.802880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.803022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.803162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.803314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.803466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.803612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.803747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.803902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.804035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.804167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.828614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.828866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.829024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.829161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.829292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.829429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.829563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.829707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.829855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.829990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.830121 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.830253 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.830385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.830385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.841940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.842139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.855396 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.855626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.855863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.856008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.856145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.856280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.856413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.856556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.856689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.856844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.856972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.857103 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66092) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.857235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.857235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66091) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 13:53:51.874071 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.874253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.874407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 13:53:51.874536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 13:53:51.874703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.874834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.874961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 13:53:51.875089 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 13:53:51.875216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.875342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.875477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.875617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.875745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.875872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.876003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.876138 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.886589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.886775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.886905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.887031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.887159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.887298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.887439 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.887569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.895869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.896057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.899005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.899159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.899333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.899483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.899621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.899804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.899964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.900101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.900236 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.900369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.900511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.900644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.900776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.900909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.901042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.901174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.901316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.901460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.901593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.901726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.901858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.902000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.927612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.927946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.929128 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.929401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.929546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.929741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.934382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.934778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.934913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.935043 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.935281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.935558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.942518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.942816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.943039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.943314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.947027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.947302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.947559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.947643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.947835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.947918 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.948104 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.948187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.948372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.948454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.948636 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.948719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.948895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.948976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.949156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.949420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.966777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.967048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.967215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.967488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.971440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.971883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.975042 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.975324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.975454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.975722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.980096 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.980492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.983708 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.983979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:51.988169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.988327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.988452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.988573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.988692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.988839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.988973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.989121 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.989244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.989392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.989516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:51.989673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.008628 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.008907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.009167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.009422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.009658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.009947 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.010211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.010472 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.016898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.018278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.018898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.019169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.020037 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.020308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.022061 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.022333 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.022614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.022903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.023167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.023307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.023497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.023780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.024053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.024322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.036659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.036927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.037199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.037468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.037602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.037728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.037874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.038020 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.038154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.038286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.038419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.038588 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.038890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.039159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.055873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.056879 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.060214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.061249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.063357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.065000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.065755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.066515 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.067321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.067608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.067863 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.068079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.068356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.068637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.143721 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.144743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.145276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.146307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.148312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.148591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.148866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.149133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.149372 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.149659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.149940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.150210 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.157980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.158266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.158536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.159177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.159460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.159732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.165947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66092) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.166216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.166763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.167036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.167309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.167402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66091) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 13:53:52.167580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.167710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.167841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.167927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.168105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.168197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.168362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.168452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.168633 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.168729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.168904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.168996 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.169160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.169250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.169457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.169554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.169716 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.169796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66092) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.169991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.170261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.170520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.170897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66091) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 13:53:52.207148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55884a4ec9c0 pid: 66092 (default app) Oct 27 13:53:52.208279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55884a4ec9c0 pid: 66091 (default app) Oct 27 13:53:52.210401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290795d8-25a2-4da1-8701-f509eefbdae9 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:53:52.210727 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290795d8-25a2-4da1-8701-f509eefbdae9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:53:52.211014 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290795d8-25a2-4da1-8701-f509eefbdae9 None None] PATH_INFO: `/v3` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:53:52.215028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Wed Oct 27 13:53:52 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:53:57.725459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83cc69-cf8e-4b5a-9749-de2292ffa678 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:53:57.725993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83cc69-cf8e-4b5a-9749-de2292ffa678 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:53:57.726078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83cc69-cf8e-4b5a-9749-de2292ffa678 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:53:57.731083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:53:57 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:53:57.738206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:53:57.738713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:53:57.738803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:53:57.778273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG oslo_db.sqlalchemy.engines [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Oct 27 13:53:57.928277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG passlib.handlers.bcrypt [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66092) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Oct 27 13:53:57.928706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG passlib.handlers.bcrypt [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66092) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Oct 27 13:53:57.994171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:53:57.995680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:53:58.099970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:53:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:53:58.284170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83cc69-cf8e-4b5a-9749-de2292ffa678 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:53:58.326307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG oslo_db.sqlalchemy.engines [None req-2d83cc69-cf8e-4b5a-9749-de2292ffa678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Oct 27 13:53:58.421071 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83cc69-cf8e-4b5a-9749-de2292ffa678 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:53:58.425564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9b3bb-6d2e-4a8f-abec-04b1a7f44980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:53:58.426159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9b3bb-6d2e-4a8f-abec-04b1a7f44980 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:53:58.426459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9b3bb-6d2e-4a8f-abec-04b1a7f44980 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:53:58.426771 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9b3bb-6d2e-4a8f-abec-04b1a7f44980 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:53:58.435038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9b3bb-6d2e-4a8f-abec-04b1a7f44980 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:53:58.465474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dcb9b3bb-6d2e-4a8f-abec-04b1a7f44980 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 13:53:58.465812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9b3bb-6d2e-4a8f-abec-04b1a7f44980 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:53:58.475235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:53:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:53:58.481166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:53:58.493223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d3b83-b9a7-48be-b774-3147b750725c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:53:58.497224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c53178-08db-47af-9876-e935acc16a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:53:58.498024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c53178-08db-47af-9876-e935acc16a51 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:53:58.498321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c53178-08db-47af-9876-e935acc16a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:53:58.498608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c53178-08db-47af-9876-e935acc16a51 admin admin] PATH_INFO: `/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:53:58.499908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c53178-08db-47af-9876-e935acc16a51 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdb79eb1d18d4b408274e7d70cc19ee8)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:53:58.530680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.common.rbac_enforcer.enforcer [None req-04c53178-08db-47af-9876-e935acc16a51 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 13:53:58.531023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c53178-08db-47af-9876-e935acc16a51 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:53:58.536365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:53:58 2021] GET /identity/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:54:00.715659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf333-72fe-441e-99bb-b9d8542cc6da None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:00.716180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf333-72fe-441e-99bb-b9d8542cc6da None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:00.716268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf333-72fe-441e-99bb-b9d8542cc6da None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:00.721120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:00 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:00.727682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0762d80-3cb2-4717-acc8-c7c17bbfb005 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:00.728098 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0762d80-3cb2-4717-acc8-c7c17bbfb005 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:00.728244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0762d80-3cb2-4717-acc8-c7c17bbfb005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:00.757003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a0762d80-3cb2-4717-acc8-c7c17bbfb005 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:00.759052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a0762d80-3cb2-4717-acc8-c7c17bbfb005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:00.767687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:00.793856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edf333-72fe-441e-99bb-b9d8542cc6da None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:00.806112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edf333-72fe-441e-99bb-b9d8542cc6da None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:00.809871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbee97-ac07-4323-a66c-60269e055da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:00.810466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbee97-ac07-4323-a66c-60269e055da8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:00.810784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbee97-ac07-4323-a66c-60269e055da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:00.811070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbee97-ac07-4323-a66c-60269e055da8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:00.819487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbee97-ac07-4323-a66c-60269e055da8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:00.848315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbee97-ac07-4323-a66c-60269e055da8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:00.858547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:54:00.865433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0762d80-3cb2-4717-acc8-c7c17bbfb005 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:00.875321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0762d80-3cb2-4717-acc8-c7c17bbfb005 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:00.879940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1da65a-18b6-48cc-bccd-f612e1cfd457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:00.880765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1da65a-18b6-48cc-bccd-f612e1cfd457 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:00.881113 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1da65a-18b6-48cc-bccd-f612e1cfd457 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:00.881614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1da65a-18b6-48cc-bccd-f612e1cfd457 admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:00.883777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1da65a-18b6-48cc-bccd-f612e1cfd457 admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:00.919336 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1da65a-18b6-48cc-bccd-f612e1cfd457 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:00.921364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:00 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:03.072727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca0380-7411-4c0c-bb14-17bdd301027a None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:03.073273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca0380-7411-4c0c-bb14-17bdd301027a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:03.073273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca0380-7411-4c0c-bb14-17bdd301027a None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:03.074989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:03.080159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a10ea-ebf5-4b9f-b0ce-88fae68b527e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:03.080557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a10ea-ebf5-4b9f-b0ce-88fae68b527e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:03.080735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a10ea-ebf5-4b9f-b0ce-88fae68b527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:03.102592 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-117a10ea-ebf5-4b9f-b0ce-88fae68b527e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:03.103739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-117a10ea-ebf5-4b9f-b0ce-88fae68b527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:03.110502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:03.132760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca0380-7411-4c0c-bb14-17bdd301027a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:03.144690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca0380-7411-4c0c-bb14-17bdd301027a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:03.148481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43348493-e99f-4fd7-84f4-9429c301dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:03.149202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43348493-e99f-4fd7-84f4-9429c301dd5a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:03.149499 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43348493-e99f-4fd7-84f4-9429c301dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:03.149788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43348493-e99f-4fd7-84f4-9429c301dd5a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:03.163367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43348493-e99f-4fd7-84f4-9429c301dd5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:03.169574 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-43348493-e99f-4fd7-84f4-9429c301dd5a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:54:03.170686 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 6/12] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:54:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:03.176588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a10ea-ebf5-4b9f-b0ce-88fae68b527e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:03.185339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a10ea-ebf5-4b9f-b0ce-88fae68b527e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:03.189487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:03.190088 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:03.190387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:03.190706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:03.191425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:03.191730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:03.218282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:03.218282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:54:03.218282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:54:03.219212 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:03.231598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 7/13] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:03.237451 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43348493-e99f-4fd7-84f4-9429c301dd5a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:03.247334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43348493-e99f-4fd7-84f4-9429c301dd5a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:03.251337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d09a30-2484-45fe-aa92-6c4bbbe7e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:03.252259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d09a30-2484-45fe-aa92-6c4bbbe7e56d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:03.252558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d09a30-2484-45fe-aa92-6c4bbbe7e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:03.252852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d09a30-2484-45fe-aa92-6c4bbbe7e56d admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:03.254364 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d09a30-2484-45fe-aa92-6c4bbbe7e56d admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:03.279679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d09a30-2484-45fe-aa92-6c4bbbe7e56d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:03.281064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:03 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:03.286927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:03.296337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7a2a-7796-48fe-8340-7f5506226c26 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:03.300452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04ca90-c4ec-4068-af5d-1b661b4e219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:03.301173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04ca90-c4ec-4068-af5d-1b661b4e219f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:03.301470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04ca90-c4ec-4068-af5d-1b661b4e219f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:03.301760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04ca90-c4ec-4068-af5d-1b661b4e219f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:03.302875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04ca90-c4ec-4068-af5d-1b661b4e219f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:03.331410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04ca90-c4ec-4068-af5d-1b661b4e219f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:03.332901 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:03.338523 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d09a30-2484-45fe-aa92-6c4bbbe7e56d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:03.348474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d09a30-2484-45fe-aa92-6c4bbbe7e56d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:03.352352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e4a35-c601-4791-95f8-99c87c9a9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:03.352929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e4a35-c601-4791-95f8-99c87c9a9e5a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:03.353220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e4a35-c601-4791-95f8-99c87c9a9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:03.353505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e4a35-c601-4791-95f8-99c87c9a9e5a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:03.354273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e4a35-c601-4791-95f8-99c87c9a9e5a admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.domain.id=default, user.id=35ed18ce25b9435aaf42d0a0ed7b1a41) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:03.354579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e4a35-c601-4791-95f8-99c87c9a9e5a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:03.379449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-327e4a35-c601-4791-95f8-99c87c9a9e5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:03.379449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:54:03.379449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:54:03.380586 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e4a35-c601-4791-95f8-99c87c9a9e5a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:03.387280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 8/16] 10.222.0.36 () {56 vars in 1343 bytes} [Wed Oct 27 13:54:03 2021] GET /identity/v3/role_assignments?user.id=35ed18ce25b9435aaf42d0a0ed7b1a41&scope.domain.id=default&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 233 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:05.303351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53608806-52cd-462d-833b-8e49e6d8dbd1 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:05.303839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53608806-52cd-462d-833b-8e49e6d8dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:05.303839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53608806-52cd-462d-833b-8e49e6d8dbd1 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:05.305898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 9/17] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:05.311141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7855d7-ba78-4a91-8102-a85a13bf50db None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:05.311536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7855d7-ba78-4a91-8102-a85a13bf50db None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:05.311728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7855d7-ba78-4a91-8102-a85a13bf50db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:05.345762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG passlib.handlers.bcrypt [None req-de7855d7-ba78-4a91-8102-a85a13bf50db None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66091) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Oct 27 13:54:05.346298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG passlib.handlers.bcrypt [None req-de7855d7-ba78-4a91-8102-a85a13bf50db None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66091) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Oct 27 13:54:05.393338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-de7855d7-ba78-4a91-8102-a85a13bf50db None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:05.394926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-de7855d7-ba78-4a91-8102-a85a13bf50db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:05.401917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:05.424112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53608806-52cd-462d-833b-8e49e6d8dbd1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:05.435838 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53608806-52cd-462d-833b-8e49e6d8dbd1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:05.440375 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df552822-ac26-45a3-85b4-50ed1c2a353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:05.441088 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df552822-ac26-45a3-85b4-50ed1c2a353f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:05.441382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df552822-ac26-45a3-85b4-50ed1c2a353f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:05.441670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df552822-ac26-45a3-85b4-50ed1c2a353f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:05.452909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df552822-ac26-45a3-85b4-50ed1c2a353f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:05.459335 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-df552822-ac26-45a3-85b4-50ed1c2a353f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:54:05.460442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:54:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:05.466055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7855d7-ba78-4a91-8102-a85a13bf50db None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:05.474755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7855d7-ba78-4a91-8102-a85a13bf50db None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:05.478720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:05.479324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:05.479621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:05.479911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:05.480628 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:05.480927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:05.507200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:05.507200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:54:05.507200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:54:05.508105 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:05.518915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:05.524495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df552822-ac26-45a3-85b4-50ed1c2a353f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:05.535287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df552822-ac26-45a3-85b4-50ed1c2a353f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:05.539233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb994d7c-2c5f-4e6b-b395-30f416907325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:05.540016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb994d7c-2c5f-4e6b-b395-30f416907325 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:05.540306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb994d7c-2c5f-4e6b-b395-30f416907325 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:05.540591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb994d7c-2c5f-4e6b-b395-30f416907325 admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:05.541667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb994d7c-2c5f-4e6b-b395-30f416907325 admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:05.566649 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb994d7c-2c5f-4e6b-b395-30f416907325 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:05.568010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:05 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:05.573205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:05.583027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75da1d6-068e-47ac-ae3d-f416341ca0f7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:05.586939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86bba5-771f-47d1-ab9b-bf1aa627d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:05.587653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86bba5-771f-47d1-ab9b-bf1aa627d47f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:05.587949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86bba5-771f-47d1-ab9b-bf1aa627d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:05.588238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86bba5-771f-47d1-ab9b-bf1aa627d47f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:05.589326 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86bba5-771f-47d1-ab9b-bf1aa627d47f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:05.615261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86bba5-771f-47d1-ab9b-bf1aa627d47f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:05.616671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 11/22] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:54:05.621926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb994d7c-2c5f-4e6b-b395-30f416907325 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:05.631421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb994d7c-2c5f-4e6b-b395-30f416907325 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:05.635400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e1210-23a0-4ab1-afa9-50e403157b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:05.636267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1210-23a0-4ab1-afa9-50e403157b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:05.636481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1210-23a0-4ab1-afa9-50e403157b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:05.636774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1210-23a0-4ab1-afa9-50e403157b24 admin admin] PATH_INFO: `/v3/domains/default/users/35ed18ce25b9435aaf42d0a0ed7b1a41/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:05.638540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e1210-23a0-4ab1-afa9-50e403157b24 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=35ed18ce25b9435aaf42d0a0ed7b1a41, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:05.664408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-861e1210-23a0-4ab1-afa9-50e403157b24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:05.664408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:54:05.664408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:54:05.666394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e1210-23a0-4ab1-afa9-50e403157b24 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:05.863643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1382 bytes} [Wed Oct 27 13:54:05 2021] PUT /identity/v3/domains/default/users/35ed18ce25b9435aaf42d0a0ed7b1a41/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:54:07.823671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0a6d-50fb-4682-99ae-6449f4e27522 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:07.824215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0a6d-50fb-4682-99ae-6449f4e27522 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:07.824323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b0a6d-50fb-4682-99ae-6449f4e27522 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:07.825917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:54:07.832042 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76808a1e-7137-4fc9-8996-7279299ca046 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:07.832480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76808a1e-7137-4fc9-8996-7279299ca046 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:07.832629 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76808a1e-7137-4fc9-8996-7279299ca046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:07.856331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-76808a1e-7137-4fc9-8996-7279299ca046 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:07.857794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-76808a1e-7137-4fc9-8996-7279299ca046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:07.922484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:54:07.945098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0a6d-50fb-4682-99ae-6449f4e27522 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:07.956618 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b0a6d-50fb-4682-99ae-6449f4e27522 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:07.960444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe785-a445-4b25-b7ee-8390c4d0dee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:07.961159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe785-a445-4b25-b7ee-8390c4d0dee9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:07.961455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe785-a445-4b25-b7ee-8390c4d0dee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:07.961743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe785-a445-4b25-b7ee-8390c4d0dee9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:07.974734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfe785-a445-4b25-b7ee-8390c4d0dee9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:07.982262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-0abfe785-a445-4b25-b7ee-8390c4d0dee9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:54:07.983425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 13/26] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:54:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:07.989955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76808a1e-7137-4fc9-8996-7279299ca046 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:07.998820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76808a1e-7137-4fc9-8996-7279299ca046 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:08.003503 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579f7d1-2d59-46e0-93dd-98aad5259e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:08.004113 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579f7d1-2d59-46e0-93dd-98aad5259e28 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:08.004413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579f7d1-2d59-46e0-93dd-98aad5259e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:08.004705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579f7d1-2d59-46e0-93dd-98aad5259e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:08.005428 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579f7d1-2d59-46e0-93dd-98aad5259e28 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:08.005734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579f7d1-2d59-46e0-93dd-98aad5259e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:08.030979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579f7d1-2d59-46e0-93dd-98aad5259e28 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:08.043943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 14/27] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:08.050306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe785-a445-4b25-b7ee-8390c4d0dee9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:08.059764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe785-a445-4b25-b7ee-8390c4d0dee9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:08.063888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afb90c-978a-4401-935f-bc4c0c5ae9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:08.064837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afb90c-978a-4401-935f-bc4c0c5ae9ec admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:08.065135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afb90c-978a-4401-935f-bc4c0c5ae9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:08.065424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afb90c-978a-4401-935f-bc4c0c5ae9ec admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:08.066529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afb90c-978a-4401-935f-bc4c0c5ae9ec admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:08.091662 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afb90c-978a-4401-935f-bc4c0c5ae9ec admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:08.093040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 14/28] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:08 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:08.099110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579f7d1-2d59-46e0-93dd-98aad5259e28 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:08.108476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579f7d1-2d59-46e0-93dd-98aad5259e28 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:08.113422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d04e42-904b-468d-9f44-697da9ab6c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:08.114138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d04e42-904b-468d-9f44-697da9ab6c39 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:08.114433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d04e42-904b-468d-9f44-697da9ab6c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:08.114754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d04e42-904b-468d-9f44-697da9ab6c39 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:08.115991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d04e42-904b-468d-9f44-697da9ab6c39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:08.140766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d04e42-904b-468d-9f44-697da9ab6c39 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:08.142313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:08.148162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afb90c-978a-4401-935f-bc4c0c5ae9ec admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:08.157836 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afb90c-978a-4401-935f-bc4c0c5ae9ec admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:08.161924 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78aa7-b3fa-4b22-b952-25bfc6ec8678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:08.162496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78aa7-b3fa-4b22-b952-25bfc6ec8678 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:08.162838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78aa7-b3fa-4b22-b952-25bfc6ec8678 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:08.163123 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78aa7-b3fa-4b22-b952-25bfc6ec8678 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:08.163901 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78aa7-b3fa-4b22-b952-25bfc6ec8678 admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.domain.id=default, user.id=35ed18ce25b9435aaf42d0a0ed7b1a41) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:08.164205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78aa7-b3fa-4b22-b952-25bfc6ec8678 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:08.189727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78aa7-b3fa-4b22-b952-25bfc6ec8678 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:08.195688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 15/30] 10.222.0.36 () {56 vars in 1343 bytes} [Wed Oct 27 13:54:08 2021] GET /identity/v3/role_assignments?user.id=35ed18ce25b9435aaf42d0a0ed7b1a41&scope.domain.id=default&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 530 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:10.174480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b8089-1505-463a-b1cd-2912c7601c11 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:10.175050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b8089-1505-463a-b1cd-2912c7601c11 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:10.175157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b8089-1505-463a-b1cd-2912c7601c11 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:10.176790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 16/31] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:10.182150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b3b0-4103-48c9-ada6-fc4205fd6ce0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:10.182556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b3b0-4103-48c9-ada6-fc4205fd6ce0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:10.182764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b3b0-4103-48c9-ada6-fc4205fd6ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:10.206152 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3752b3b0-4103-48c9-ada6-fc4205fd6ce0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:10.207332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3752b3b0-4103-48c9-ada6-fc4205fd6ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:10.214085 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 16/32] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:10.236113 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b8089-1505-463a-b1cd-2912c7601c11 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:10.248146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b8089-1505-463a-b1cd-2912c7601c11 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:10.252544 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b36bde-2ba0-470c-84d5-d87c7a38cceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:10.253126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b36bde-2ba0-470c-84d5-d87c7a38cceb admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:10.253424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b36bde-2ba0-470c-84d5-d87c7a38cceb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:10.253717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b36bde-2ba0-470c-84d5-d87c7a38cceb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:10.261457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b36bde-2ba0-470c-84d5-d87c7a38cceb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:10.287427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b36bde-2ba0-470c-84d5-d87c7a38cceb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:10.296518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 17/33] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:54:10.302859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b3b0-4103-48c9-ada6-fc4205fd6ce0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:10.311528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b3b0-4103-48c9-ada6-fc4205fd6ce0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:10.315831 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd1eb5-f7e9-4f9a-9cf6-0f521030af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:10.316557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd1eb5-f7e9-4f9a-9cf6-0f521030af48 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:10.316854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd1eb5-f7e9-4f9a-9cf6-0f521030af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:10.317146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd1eb5-f7e9-4f9a-9cf6-0f521030af48 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:10.318214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd1eb5-f7e9-4f9a-9cf6-0f521030af48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:10.343126 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd1eb5-f7e9-4f9a-9cf6-0f521030af48 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:10.344575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 17/34] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:12.291992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b945-a46f-47ba-b1e7-f080c9b1380e None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:12.292485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b945-a46f-47ba-b1e7-f080c9b1380e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:12.292485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b945-a46f-47ba-b1e7-f080c9b1380e None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:12.294289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 18/35] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:12.300357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc773d8-94c8-4420-aeb5-460cc69929f9 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:12.300731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc773d8-94c8-4420-aeb5-460cc69929f9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:12.300927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc773d8-94c8-4420-aeb5-460cc69929f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:12.324051 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-efc773d8-94c8-4420-aeb5-460cc69929f9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:12.325336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-efc773d8-94c8-4420-aeb5-460cc69929f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:12.332238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 18/36] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:12.354263 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b945-a46f-47ba-b1e7-f080c9b1380e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:12.366812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b945-a46f-47ba-b1e7-f080c9b1380e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:12.370675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6bc66-1090-461c-afb5-9d70848b5bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:12.371399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6bc66-1090-461c-afb5-9d70848b5bac admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:12.371704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6bc66-1090-461c-afb5-9d70848b5bac admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:12.371997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6bc66-1090-461c-afb5-9d70848b5bac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:12.384783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6bc66-1090-461c-afb5-9d70848b5bac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:12.410100 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6bc66-1090-461c-afb5-9d70848b5bac admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:12.427805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-30a6bc66-1090-461c-afb5-9d70848b5bac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:54:12.428894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 19/37] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:12.434870 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc773d8-94c8-4420-aeb5-460cc69929f9 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:12.444547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc773d8-94c8-4420-aeb5-460cc69929f9 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:12.448472 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe1d76-8759-4c6c-9c83-dfa5c961ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:12.449060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe1d76-8759-4c6c-9c83-dfa5c961ae37 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:12.449347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe1d76-8759-4c6c-9c83-dfa5c961ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:12.449627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe1d76-8759-4c6c-9c83-dfa5c961ae37 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:12.450302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe1d76-8759-4c6c-9c83-dfa5c961ae37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:12.450601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe1d76-8759-4c6c-9c83-dfa5c961ae37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:12.474608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-c1fe1d76-8759-4c6c-9c83-dfa5c961ae37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:12.474608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:54:12.474608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:54:12.475532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe1d76-8759-4c6c-9c83-dfa5c961ae37 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:12.491776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:54:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:12.497315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6bc66-1090-461c-afb5-9d70848b5bac admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:12.508057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6bc66-1090-461c-afb5-9d70848b5bac admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:12.512031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946102db-064e-467f-bdaa-ce52bdb640a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:12.512614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946102db-064e-467f-bdaa-ce52bdb640a1 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:12.512912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946102db-064e-467f-bdaa-ce52bdb640a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:12.513205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946102db-064e-467f-bdaa-ce52bdb640a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:12.513866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946102db-064e-467f-bdaa-ce52bdb640a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:12.539067 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-946102db-064e-467f-bdaa-ce52bdb640a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:12.539067 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:54:12.539067 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:54:12.540268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946102db-064e-467f-bdaa-ce52bdb640a1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:12.569225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:54:12 2021] POST /identity/v3/projects => generated 301 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:54:14.646050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8ce7b-2e5b-4fa4-bef2-6f4a30a92ae4 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:14.646608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8ce7b-2e5b-4fa4-bef2-6f4a30a92ae4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:14.646608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8ce7b-2e5b-4fa4-bef2-6f4a30a92ae4 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:14.648329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 20/40] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:14.654589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796bd1b-5586-47c2-b7b8-95f84f1dcf97 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:14.655077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796bd1b-5586-47c2-b7b8-95f84f1dcf97 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:14.655225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796bd1b-5586-47c2-b7b8-95f84f1dcf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:14.682873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a796bd1b-5586-47c2-b7b8-95f84f1dcf97 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:14.684567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a796bd1b-5586-47c2-b7b8-95f84f1dcf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:14.760939 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 21/41] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:54:14.788904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8ce7b-2e5b-4fa4-bef2-6f4a30a92ae4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:14.803883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8ce7b-2e5b-4fa4-bef2-6f4a30a92ae4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:14.807784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1caaab-c8cd-4305-8aea-c919b2b8ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:14.808471 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1caaab-c8cd-4305-8aea-c919b2b8ca16 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:14.808772 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1caaab-c8cd-4305-8aea-c919b2b8ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:14.809060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1caaab-c8cd-4305-8aea-c919b2b8ca16 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:14.809806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1caaab-c8cd-4305-8aea-c919b2b8ca16 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:14.842869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-0c1caaab-c8cd-4305-8aea-c919b2b8ca16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:14.842869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:54:14.842869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:54:14.844406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1caaab-c8cd-4305-8aea-c919b2b8ca16 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:15.054336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 13:54:14 2021] POST /identity/v3/roles => generated 219 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:54:17.030009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b5550-139e-45d9-84d2-e35d7d4c677b None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:17.030416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b5550-139e-45d9-84d2-e35d7d4c677b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:17.030609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b5550-139e-45d9-84d2-e35d7d4c677b None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:17.032395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 22/43] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:17.038162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a0da5-ab6f-4455-aecc-1b173498f6ab None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:17.038607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a0da5-ab6f-4455-aecc-1b173498f6ab None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:17.039054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a0da5-ab6f-4455-aecc-1b173498f6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:17.061704 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6d8a0da5-ab6f-4455-aecc-1b173498f6ab None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:17.063180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6d8a0da5-ab6f-4455-aecc-1b173498f6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:17.070927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 22/44] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:17.093123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b5550-139e-45d9-84d2-e35d7d4c677b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:17.104675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b5550-139e-45d9-84d2-e35d7d4c677b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:17.108502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04bf5d-91f4-463a-bc1f-231d0286cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:17.109091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04bf5d-91f4-463a-bc1f-231d0286cfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:17.109387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04bf5d-91f4-463a-bc1f-231d0286cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:17.109675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04bf5d-91f4-463a-bc1f-231d0286cfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:17.110676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04bf5d-91f4-463a-bc1f-231d0286cfb0 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:17.135515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-bb04bf5d-91f4-463a-bc1f-231d0286cfb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:17.135515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:54:17.135515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:54:17.136425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04bf5d-91f4-463a-bc1f-231d0286cfb0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:17.151205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 13:54:17 2021] POST /identity/v3/roles => generated 225 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:54:19.148097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cf388-06fc-47f2-ae16-76fe763aea8c None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:19.148638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cf388-06fc-47f2-ae16-76fe763aea8c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:19.148727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cf388-06fc-47f2-ae16-76fe763aea8c None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:19.150421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 23/46] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:19.155730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e69c29-cbb4-4094-95b8-ef6f8a952d1d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:19.156149 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e69c29-cbb4-4094-95b8-ef6f8a952d1d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:19.156305 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e69c29-cbb4-4094-95b8-ef6f8a952d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:19.179030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-01e69c29-cbb4-4094-95b8-ef6f8a952d1d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:19.180155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-01e69c29-cbb4-4094-95b8-ef6f8a952d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:19.186739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 24/47] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:19.208707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cf388-06fc-47f2-ae16-76fe763aea8c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:19.226018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cf388-06fc-47f2-ae16-76fe763aea8c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:19.229941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d7c81-f7da-41c1-a81e-1f8fe74e38ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:19.230551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d7c81-f7da-41c1-a81e-1f8fe74e38ec admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:19.230880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d7c81-f7da-41c1-a81e-1f8fe74e38ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:19.231173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d7c81-f7da-41c1-a81e-1f8fe74e38ec admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:19.231874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d7c81-f7da-41c1-a81e-1f8fe74e38ec admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:19.257706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d7c81-f7da-41c1-a81e-1f8fe74e38ec admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:19.271905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 24/48] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 13:54:19 2021] POST /identity/v3/roles => generated 223 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:54:21.228181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100728a-faad-4855-ba2c-23404b55812d None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:21.228688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100728a-faad-4855-ba2c-23404b55812d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:21.228760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100728a-faad-4855-ba2c-23404b55812d None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:21.230735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 25/49] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:21.236026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f0b88-dc18-4eee-a79a-374c2b586008 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:21.236464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f0b88-dc18-4eee-a79a-374c2b586008 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:21.236698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f0b88-dc18-4eee-a79a-374c2b586008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:21.260616 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-124f0b88-dc18-4eee-a79a-374c2b586008 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:21.261796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-124f0b88-dc18-4eee-a79a-374c2b586008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:21.269434 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 25/50] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:21.291898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100728a-faad-4855-ba2c-23404b55812d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:21.303828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100728a-faad-4855-ba2c-23404b55812d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:21.307753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964f9a3-78c0-41f9-9018-d57c1096ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:21.308476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964f9a3-78c0-41f9-9018-d57c1096ac7c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:21.308777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964f9a3-78c0-41f9-9018-d57c1096ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:21.309065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964f9a3-78c0-41f9-9018-d57c1096ac7c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:21.310127 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964f9a3-78c0-41f9-9018-d57c1096ac7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:21.335885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964f9a3-78c0-41f9-9018-d57c1096ac7c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:21.337351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 26/51] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:21.342841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f0b88-dc18-4eee-a79a-374c2b586008 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:21.352294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f0b88-dc18-4eee-a79a-374c2b586008 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:21.356293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4b452-f70e-4ed5-8fcb-31590a609777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:21.356852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4b452-f70e-4ed5-8fcb-31590a609777 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:21.357150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4b452-f70e-4ed5-8fcb-31590a609777 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:21.357481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4b452-f70e-4ed5-8fcb-31590a609777 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:21.358276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4b452-f70e-4ed5-8fcb-31590a609777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:21.382926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-d4b4b452-f70e-4ed5-8fcb-31590a609777 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:21.382926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:54:21.382926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:54:21.384133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4b452-f70e-4ed5-8fcb-31590a609777 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:21.412966 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:54:21 2021] POST /identity/v3/projects => generated 312 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:54:23.370642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91ab0-ad4e-46d6-a63d-a7f0d3d7fb72 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:23.371154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91ab0-ad4e-46d6-a63d-a7f0d3d7fb72 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:23.371237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91ab0-ad4e-46d6-a63d-a7f0d3d7fb72 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:23.372913 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 27/53] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:23.377939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f603e40-75ba-4119-9e09-3fa282ca10e6 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:23.378334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f603e40-75ba-4119-9e09-3fa282ca10e6 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:23.378525 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f603e40-75ba-4119-9e09-3fa282ca10e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:23.400653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8f603e40-75ba-4119-9e09-3fa282ca10e6 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:23.401788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8f603e40-75ba-4119-9e09-3fa282ca10e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:23.467248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 27/54] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:23.490468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91ab0-ad4e-46d6-a63d-a7f0d3d7fb72 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:23.502216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91ab0-ad4e-46d6-a63d-a7f0d3d7fb72 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:23.506079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bcf5d-80b8-436e-9001-609d2aa09f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:23.506822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bcf5d-80b8-436e-9001-609d2aa09f3f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:23.507123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bcf5d-80b8-436e-9001-609d2aa09f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:23.507410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bcf5d-80b8-436e-9001-609d2aa09f3f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:23.508468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bcf5d-80b8-436e-9001-609d2aa09f3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:23.534514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bcf5d-80b8-436e-9001-609d2aa09f3f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:23.535986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:23.541385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f603e40-75ba-4119-9e09-3fa282ca10e6 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:23.550214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f603e40-75ba-4119-9e09-3fa282ca10e6 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:23.554156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4e721-f32b-4c08-9198-2d80d21419e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:23.554790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e721-f32b-4c08-9198-2d80d21419e0 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:23.555091 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e721-f32b-4c08-9198-2d80d21419e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:23.555383 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e721-f32b-4c08-9198-2d80d21419e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:23.556031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4e721-f32b-4c08-9198-2d80d21419e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:23.581782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4e721-f32b-4c08-9198-2d80d21419e0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:23.608038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 28/56] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Oct 27 13:54:23 2021] POST /identity/v3/projects => generated 298 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:54:25.570645 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f0b80-b81d-44a9-baf6-d808e6f8a673 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:25.571201 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f0b80-b81d-44a9-baf6-d808e6f8a673 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:25.571295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f0b80-b81d-44a9-baf6-d808e6f8a673 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:25.572922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 29/57] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:25.578269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8f18c-a75a-457f-abbe-92440a3878a0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:25.578757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8f18c-a75a-457f-abbe-92440a3878a0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:25.578895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8f18c-a75a-457f-abbe-92440a3878a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:25.601958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-fca8f18c-a75a-457f-abbe-92440a3878a0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:25.603164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fca8f18c-a75a-457f-abbe-92440a3878a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:25.668417 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 29/58] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:25.696030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f0b80-b81d-44a9-baf6-d808e6f8a673 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:25.708731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f0b80-b81d-44a9-baf6-d808e6f8a673 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:25.712609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e647-c61f-4efc-a069-0af99bfd6ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:25.713326 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e647-c61f-4efc-a069-0af99bfd6ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:25.713626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e647-c61f-4efc-a069-0af99bfd6ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:25.713920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e647-c61f-4efc-a069-0af99bfd6ad2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:25.715015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e647-c61f-4efc-a069-0af99bfd6ad2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:25.741219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e647-c61f-4efc-a069-0af99bfd6ad2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:25.742699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:25.748131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8f18c-a75a-457f-abbe-92440a3878a0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:25.756806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8f18c-a75a-457f-abbe-92440a3878a0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:25.760760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0b180-ab4e-41aa-be58-333f6a07153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:25.761358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b180-ab4e-41aa-be58-333f6a07153b admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:25.761651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b180-ab4e-41aa-be58-333f6a07153b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:25.761936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b180-ab4e-41aa-be58-333f6a07153b admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:25.762580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0b180-ab4e-41aa-be58-333f6a07153b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:25.788234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-8ef0b180-ab4e-41aa-be58-333f6a07153b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:25.788234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:54:25.788234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:54:25.789455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0b180-ab4e-41aa-be58-333f6a07153b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:25.813225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 30/60] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:54:25 2021] POST /identity/v3/users => generated 275 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:54:27.776898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0fc62-946d-4184-b084-4de1a756f823 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:27.777416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0fc62-946d-4184-b084-4de1a756f823 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:27.777526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0fc62-946d-4184-b084-4de1a756f823 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:27.779191 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 31/61] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:27.784367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc638f1c-b87e-4552-a140-cccec6c34371 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:27.784775 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc638f1c-b87e-4552-a140-cccec6c34371 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:27.784955 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc638f1c-b87e-4552-a140-cccec6c34371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:27.807182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-fc638f1c-b87e-4552-a140-cccec6c34371 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:27.808311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fc638f1c-b87e-4552-a140-cccec6c34371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:27.815570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 31/62] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:27.838242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0fc62-946d-4184-b084-4de1a756f823 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:27.849947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0fc62-946d-4184-b084-4de1a756f823 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:27.853835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd41677-7735-416c-ab02-355a7c8a1402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:27.854558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd41677-7735-416c-ab02-355a7c8a1402 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:27.854886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd41677-7735-416c-ab02-355a7c8a1402 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:27.855177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd41677-7735-416c-ab02-355a7c8a1402 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:27.867194 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd41677-7735-416c-ab02-355a7c8a1402 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:27.873468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-ffd41677-7735-416c-ab02-355a7c8a1402 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:54:27.874570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 32/63] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:27.880800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc638f1c-b87e-4552-a140-cccec6c34371 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:27.889420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc638f1c-b87e-4552-a140-cccec6c34371 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:27.894168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb1d2-34b4-44c8-9297-64ed154c6514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:27.894811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb1d2-34b4-44c8-9297-64ed154c6514 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:27.895104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb1d2-34b4-44c8-9297-64ed154c6514 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:27.895402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb1d2-34b4-44c8-9297-64ed154c6514 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:27.896361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bb1d2-34b4-44c8-9297-64ed154c6514 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:27.896775 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bb1d2-34b4-44c8-9297-64ed154c6514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:27.921979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bb1d2-34b4-44c8-9297-64ed154c6514 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:27.931835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 32/64] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:54:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:27.937569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd41677-7735-416c-ab02-355a7c8a1402 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:27.948795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd41677-7735-416c-ab02-355a7c8a1402 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:27.952710 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032a4a5-327a-4fe6-aaf3-6ef5108bb4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:27.953503 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032a4a5-327a-4fe6-aaf3-6ef5108bb4bc admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:27.953799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032a4a5-327a-4fe6-aaf3-6ef5108bb4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:27.954232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032a4a5-327a-4fe6-aaf3-6ef5108bb4bc admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:27.973209 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032a4a5-327a-4fe6-aaf3-6ef5108bb4bc admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:27.999661 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032a4a5-327a-4fe6-aaf3-6ef5108bb4bc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:28.006550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 33/65] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:27 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:28.007613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb1d2-34b4-44c8-9297-64ed154c6514 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:28.017480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb1d2-34b4-44c8-9297-64ed154c6514 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:28.021392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f0aae-3b04-4830-a2ee-79af40fc37fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:28.021968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0aae-3b04-4830-a2ee-79af40fc37fb admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:28.022261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0aae-3b04-4830-a2ee-79af40fc37fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:28.022548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0aae-3b04-4830-a2ee-79af40fc37fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:28.030093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f0aae-3b04-4830-a2ee-79af40fc37fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:28.055774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f0aae-3b04-4830-a2ee-79af40fc37fb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:28.064335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 33/66] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:54:28.070053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032a4a5-327a-4fe6-aaf3-6ef5108bb4bc admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:28.080090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032a4a5-327a-4fe6-aaf3-6ef5108bb4bc admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:28.084036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3ede6-4836-403f-be61-a2c02acef864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:28.084820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3ede6-4836-403f-be61-a2c02acef864 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:28.085117 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3ede6-4836-403f-be61-a2c02acef864 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:28.085406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3ede6-4836-403f-be61-a2c02acef864 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:28.086482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3ede6-4836-403f-be61-a2c02acef864 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:28.112789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3ede6-4836-403f-be61-a2c02acef864 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:28.114325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 34/67] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:28 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:54:28.119895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f0aae-3b04-4830-a2ee-79af40fc37fb admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:28.128662 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f0aae-3b04-4830-a2ee-79af40fc37fb admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:28.132628 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877f6f4-ff2b-4fdc-87b6-238477acac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:28.133214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877f6f4-ff2b-4fdc-87b6-238477acac99 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:28.133511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877f6f4-ff2b-4fdc-87b6-238477acac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:28.133801 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877f6f4-ff2b-4fdc-87b6-238477acac99 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:28.134579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877f6f4-ff2b-4fdc-87b6-238477acac99 admin admin] RBAC: Adding query filter params (role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026, user.id=fbd81aca114b4057bcc77965ea8c47ba) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:28.134919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877f6f4-ff2b-4fdc-87b6-238477acac99 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:28.161322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877f6f4-ff2b-4fdc-87b6-238477acac99 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:28.166703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 34/68] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:54:28 2021] GET /identity/v3/role_assignments?user.id=fbd81aca114b4057bcc77965ea8c47ba&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=871d3e9701f04be1906b8ef20b10077b => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:30.117938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d993b7-751f-4326-a857-d4b5526fb451 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:30.118445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d993b7-751f-4326-a857-d4b5526fb451 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:30.118554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d993b7-751f-4326-a857-d4b5526fb451 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:30.120227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 35/69] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:30.125365 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1bc5-8dd0-4033-927b-a9cd82854138 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:30.125783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1bc5-8dd0-4033-927b-a9cd82854138 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:30.126019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1bc5-8dd0-4033-927b-a9cd82854138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:30.148625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-a0bb1bc5-8dd0-4033-927b-a9cd82854138 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:30.149765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a0bb1bc5-8dd0-4033-927b-a9cd82854138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:30.156374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 35/70] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:30.179198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d993b7-751f-4326-a857-d4b5526fb451 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:30.190851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d993b7-751f-4326-a857-d4b5526fb451 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:30.194644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8483fb-78b9-4eaa-baab-1c2ad565e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:30.195377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8483fb-78b9-4eaa-baab-1c2ad565e243 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:30.195671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8483fb-78b9-4eaa-baab-1c2ad565e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:30.195957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8483fb-78b9-4eaa-baab-1c2ad565e243 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:30.208137 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8483fb-78b9-4eaa-baab-1c2ad565e243 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:30.214382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-8f8483fb-78b9-4eaa-baab-1c2ad565e243 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:54:30.215540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:30.222316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1bc5-8dd0-4033-927b-a9cd82854138 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:30.230795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1bc5-8dd0-4033-927b-a9cd82854138 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:30.234752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04627f-3627-475a-ab3a-d8235316d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:30.235413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04627f-3627-475a-ab3a-d8235316d49a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:30.235957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04627f-3627-475a-ab3a-d8235316d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:30.236291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04627f-3627-475a-ab3a-d8235316d49a admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:30.237000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04627f-3627-475a-ab3a-d8235316d49a admin admin] RBAC: Adding query filter params (name=member) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:30.237307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04627f-3627-475a-ab3a-d8235316d49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:30.262323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04627f-3627-475a-ab3a-d8235316d49a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:30.271635 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 36/72] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:54:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:30.277060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8483fb-78b9-4eaa-baab-1c2ad565e243 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:30.289533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8483fb-78b9-4eaa-baab-1c2ad565e243 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:30.293560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09e144-4c6b-4d0b-b458-fa98964c1e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:30.294346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09e144-4c6b-4d0b-b458-fa98964c1e07 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:30.294657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09e144-4c6b-4d0b-b458-fa98964c1e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:30.294945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09e144-4c6b-4d0b-b458-fa98964c1e07 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:30.296021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09e144-4c6b-4d0b-b458-fa98964c1e07 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:30.321481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09e144-4c6b-4d0b-b458-fa98964c1e07 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:30.323002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:30 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:54:30.328298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04627f-3627-475a-ab3a-d8235316d49a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:30.338188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04627f-3627-475a-ab3a-d8235316d49a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:30.342167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d69324-b4dd-4e63-ae4d-349699613c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:30.342995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d69324-b4dd-4e63-ae4d-349699613c07 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:30.343295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d69324-b4dd-4e63-ae4d-349699613c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:30.343589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d69324-b4dd-4e63-ae4d-349699613c07 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:30.345299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d69324-b4dd-4e63-ae4d-349699613c07 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:30.371036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d69324-b4dd-4e63-ae4d-349699613c07 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:30.372562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 37/74] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:30 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:30.377927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09e144-4c6b-4d0b-b458-fa98964c1e07 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:30.387121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09e144-4c6b-4d0b-b458-fa98964c1e07 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:30.391076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9e1f-c785-48a9-8778-9c1202fc992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:30.392591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9e1f-c785-48a9-8778-9c1202fc992e admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:30.392888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9e1f-c785-48a9-8778-9c1202fc992e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:30.393173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9e1f-c785-48a9-8778-9c1202fc992e admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/users/fbd81aca114b4057bcc77965ea8c47ba/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:30.395000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e9e1f-c785-48a9-8778-9c1202fc992e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a7d1331b8144a19205ad2b0f3ce026, user_id=fbd81aca114b4057bcc77965ea8c47ba, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:30.421211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e9e1f-c785-48a9-8778-9c1202fc992e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:30.433437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 38/75] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:54:30 2021] PUT /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/users/fbd81aca114b4057bcc77965ea8c47ba/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:54:32.385190 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5442-375b-4cfa-8ea1-d38eed1afea3 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:32.385750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5442-375b-4cfa-8ea1-d38eed1afea3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:32.385750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5442-375b-4cfa-8ea1-d38eed1afea3 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:32.387487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 38/76] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:32.392479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef58c-949b-4d64-8e3a-a544ec3db07f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:32.392913 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef58c-949b-4d64-8e3a-a544ec3db07f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:32.393066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef58c-949b-4d64-8e3a-a544ec3db07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:32.416665 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-9ebef58c-949b-4d64-8e3a-a544ec3db07f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:32.417829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9ebef58c-949b-4d64-8e3a-a544ec3db07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:32.481141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 39/77] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:32.503265 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5442-375b-4cfa-8ea1-d38eed1afea3 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:32.514791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5442-375b-4cfa-8ea1-d38eed1afea3 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:32.519180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1866b-9dca-4803-a8c3-8d8aa1432236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:32.519903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1866b-9dca-4803-a8c3-8d8aa1432236 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:32.520199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1866b-9dca-4803-a8c3-8d8aa1432236 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:32.520490 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1866b-9dca-4803-a8c3-8d8aa1432236 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:32.532779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1866b-9dca-4803-a8c3-8d8aa1432236 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:32.539134 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-1dc1866b-9dca-4803-a8c3-8d8aa1432236 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:54:32.540212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 39/78] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:32.545770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef58c-949b-4d64-8e3a-a544ec3db07f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:32.554612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef58c-949b-4d64-8e3a-a544ec3db07f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:32.558540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12d51-6b84-479f-be32-364e9793e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:32.559189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12d51-6b84-479f-be32-364e9793e5ed admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:32.559467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12d51-6b84-479f-be32-364e9793e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:32.559759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12d51-6b84-479f-be32-364e9793e5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:32.560477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12d51-6b84-479f-be32-364e9793e5ed admin admin] RBAC: Adding query filter params (name=member) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:32.560783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12d51-6b84-479f-be32-364e9793e5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:32.586139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a12d51-6b84-479f-be32-364e9793e5ed admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:32.595331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 40/79] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:54:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:32.600792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1866b-9dca-4803-a8c3-8d8aa1432236 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:32.609940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1866b-9dca-4803-a8c3-8d8aa1432236 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:32.614111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff0d6e-0974-4abd-b166-8ed15b889285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:32.614935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff0d6e-0974-4abd-b166-8ed15b889285 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:32.615226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff0d6e-0974-4abd-b166-8ed15b889285 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:32.615509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff0d6e-0974-4abd-b166-8ed15b889285 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:32.616803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff0d6e-0974-4abd-b166-8ed15b889285 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:32.643850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff0d6e-0974-4abd-b166-8ed15b889285 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:32.645303 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 40/80] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:32 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:32.650717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12d51-6b84-479f-be32-364e9793e5ed admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:32.660824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a12d51-6b84-479f-be32-364e9793e5ed admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:32.664803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eaf65-c5fa-4b13-9c9d-29743b96cbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:32.665379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eaf65-c5fa-4b13-9c9d-29743b96cbbb admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:32.665680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eaf65-c5fa-4b13-9c9d-29743b96cbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:32.665971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eaf65-c5fa-4b13-9c9d-29743b96cbbb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:32.673915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eaf65-c5fa-4b13-9c9d-29743b96cbbb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:32.699045 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eaf65-c5fa-4b13-9c9d-29743b96cbbb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:32.708239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 41/81] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:54:32.713606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff0d6e-0974-4abd-b166-8ed15b889285 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:32.723444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff0d6e-0974-4abd-b166-8ed15b889285 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:32.727365 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576a24b-b42e-4847-9753-33fd715b4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:32.728142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576a24b-b42e-4847-9753-33fd715b4fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:32.728459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576a24b-b42e-4847-9753-33fd715b4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:32.728719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576a24b-b42e-4847-9753-33fd715b4fa4 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:32.729769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576a24b-b42e-4847-9753-33fd715b4fa4 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:32.756166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576a24b-b42e-4847-9753-33fd715b4fa4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:32.757643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 41/82] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:32 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:32.763333 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eaf65-c5fa-4b13-9c9d-29743b96cbbb admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:32.772565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eaf65-c5fa-4b13-9c9d-29743b96cbbb admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:32.776558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ba7ed-e1ce-458a-bb53-0183330b376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:32.777135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba7ed-e1ce-458a-bb53-0183330b376b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:32.777435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba7ed-e1ce-458a-bb53-0183330b376b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:32.777726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ba7ed-e1ce-458a-bb53-0183330b376b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:32.778499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ba7ed-e1ce-458a-bb53-0183330b376b admin admin] RBAC: Adding query filter params (role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026, user.id=fbd81aca114b4057bcc77965ea8c47ba) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:32.778849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ba7ed-e1ce-458a-bb53-0183330b376b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:32.803374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-a84ba7ed-e1ce-458a-bb53-0183330b376b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:32.803374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:54:32.803374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:54:32.804515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ba7ed-e1ce-458a-bb53-0183330b376b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:32.810400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 42/83] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:54:32 2021] GET /identity/v3/role_assignments?user.id=fbd81aca114b4057bcc77965ea8c47ba&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=871d3e9701f04be1906b8ef20b10077b => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:34.811096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45cc24-ff5c-4e50-b171-b8eb16dc60b7 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:34.811701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45cc24-ff5c-4e50-b171-b8eb16dc60b7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:34.811701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45cc24-ff5c-4e50-b171-b8eb16dc60b7 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:34.813390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 42/84] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:34.818871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5028e-b5c4-4bcc-a5c7-b85d2b12d872 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:34.819301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5028e-b5c4-4bcc-a5c7-b85d2b12d872 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:34.819452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5028e-b5c4-4bcc-a5c7-b85d2b12d872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:34.842150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a4f5028e-b5c4-4bcc-a5c7-b85d2b12d872 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:34.843316 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a4f5028e-b5c4-4bcc-a5c7-b85d2b12d872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:34.850769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 43/85] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:34.872772 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45cc24-ff5c-4e50-b171-b8eb16dc60b7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:34.884392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45cc24-ff5c-4e50-b171-b8eb16dc60b7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:34.888150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c86ac-e7fb-49d8-b646-703aaa949366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:34.888865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c86ac-e7fb-49d8-b646-703aaa949366 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:34.889161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c86ac-e7fb-49d8-b646-703aaa949366 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:34.889450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c86ac-e7fb-49d8-b646-703aaa949366 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:34.903340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c86ac-e7fb-49d8-b646-703aaa949366 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:34.910404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e11c86ac-e7fb-49d8-b646-703aaa949366 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:54:34.911510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 43/86] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:54:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:34.917208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5028e-b5c4-4bcc-a5c7-b85d2b12d872 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:34.925994 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5028e-b5c4-4bcc-a5c7-b85d2b12d872 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:34.929867 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15730-f6f1-4fec-a737-21b5943852a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:34.930457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15730-f6f1-4fec-a737-21b5943852a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:34.930788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15730-f6f1-4fec-a737-21b5943852a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:34.931083 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15730-f6f1-4fec-a737-21b5943852a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:34.931787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca15730-f6f1-4fec-a737-21b5943852a8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:34.932089 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca15730-f6f1-4fec-a737-21b5943852a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:34.958110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca15730-f6f1-4fec-a737-21b5943852a8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:34.966550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 44/87] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:34.972825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c86ac-e7fb-49d8-b646-703aaa949366 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:34.982054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c86ac-e7fb-49d8-b646-703aaa949366 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:34.986394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24200326-a201-4def-a81a-200684b5d13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:34.987213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24200326-a201-4def-a81a-200684b5d13f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:34.987509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24200326-a201-4def-a81a-200684b5d13f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:34.987795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24200326-a201-4def-a81a-200684b5d13f admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:34.988965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24200326-a201-4def-a81a-200684b5d13f admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:35.014582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24200326-a201-4def-a81a-200684b5d13f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:35.016101 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 44/88] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:34 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:35.022130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15730-f6f1-4fec-a737-21b5943852a8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:35.031482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15730-f6f1-4fec-a737-21b5943852a8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:35.035410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf44c5-0f00-48f4-8425-805bee27424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:35.035986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf44c5-0f00-48f4-8425-805bee27424e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:35.036281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf44c5-0f00-48f4-8425-805bee27424e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:35.036572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf44c5-0f00-48f4-8425-805bee27424e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:35.044136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf44c5-0f00-48f4-8425-805bee27424e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:35.070518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf44c5-0f00-48f4-8425-805bee27424e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:35.079737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 45/89] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:54:35.085262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24200326-a201-4def-a81a-200684b5d13f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:35.094687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24200326-a201-4def-a81a-200684b5d13f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:35.098577 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b1bf3-7e42-4234-97eb-c57c319d07fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:35.099426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b1bf3-7e42-4234-97eb-c57c319d07fe admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:35.099724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b1bf3-7e42-4234-97eb-c57c319d07fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:35.100045 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b1bf3-7e42-4234-97eb-c57c319d07fe admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:35.101127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b1bf3-7e42-4234-97eb-c57c319d07fe admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:35.127613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b1bf3-7e42-4234-97eb-c57c319d07fe admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:35.129139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 45/90] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:35 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:35.134737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf44c5-0f00-48f4-8425-805bee27424e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:35.143948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf44c5-0f00-48f4-8425-805bee27424e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:35.147918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158852df-1b79-47d6-b7a7-6cc7470009dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:35.148495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158852df-1b79-47d6-b7a7-6cc7470009dd admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:35.148788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158852df-1b79-47d6-b7a7-6cc7470009dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:35.149080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158852df-1b79-47d6-b7a7-6cc7470009dd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:35.149843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158852df-1b79-47d6-b7a7-6cc7470009dd admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026, user.id=35ed18ce25b9435aaf42d0a0ed7b1a41) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:35.150155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158852df-1b79-47d6-b7a7-6cc7470009dd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:35.177390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158852df-1b79-47d6-b7a7-6cc7470009dd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:35.183212 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 46/91] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:54:35 2021] GET /identity/v3/role_assignments?user.id=35ed18ce25b9435aaf42d0a0ed7b1a41&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:54:37.102611 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7d041-ead9-4437-b3f2-751ca3a58815 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:37.103143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7d041-ead9-4437-b3f2-751ca3a58815 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:37.103232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7d041-ead9-4437-b3f2-751ca3a58815 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:37.104881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 46/92] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:37.110261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51c0d8-0d2c-4164-b6c4-d4e16ba7240c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:37.111152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51c0d8-0d2c-4164-b6c4-d4e16ba7240c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:37.111284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51c0d8-0d2c-4164-b6c4-d4e16ba7240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:37.134184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6b51c0d8-0d2c-4164-b6c4-d4e16ba7240c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:37.135068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6b51c0d8-0d2c-4164-b6c4-d4e16ba7240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:37.142862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 47/93] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:37.164234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7d041-ead9-4437-b3f2-751ca3a58815 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:37.177098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7d041-ead9-4437-b3f2-751ca3a58815 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:37.181764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf9ec8-651e-4556-accc-17632009df11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:37.182492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf9ec8-651e-4556-accc-17632009df11 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:37.182822 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf9ec8-651e-4556-accc-17632009df11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:37.183115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf9ec8-651e-4556-accc-17632009df11 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:37.194982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf9ec8-651e-4556-accc-17632009df11 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:37.201270 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-3bdf9ec8-651e-4556-accc-17632009df11 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:54:37.202385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 47/94] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:54:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:37.208680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51c0d8-0d2c-4164-b6c4-d4e16ba7240c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:37.217240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51c0d8-0d2c-4164-b6c4-d4e16ba7240c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:37.221783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced013e-f20e-419c-98af-ead549e4ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:37.222375 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced013e-f20e-419c-98af-ead549e4ecce admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:37.222768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced013e-f20e-419c-98af-ead549e4ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:37.222979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced013e-f20e-419c-98af-ead549e4ecce admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:37.223680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced013e-f20e-419c-98af-ead549e4ecce admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:37.223984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced013e-f20e-419c-98af-ead549e4ecce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:37.249110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced013e-f20e-419c-98af-ead549e4ecce admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:37.258480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 48/95] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:37.263864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf9ec8-651e-4556-accc-17632009df11 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:37.274685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf9ec8-651e-4556-accc-17632009df11 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:37.278580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83946979-ee71-4e13-b555-ee28f83b560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:37.279395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83946979-ee71-4e13-b555-ee28f83b560f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:37.279691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83946979-ee71-4e13-b555-ee28f83b560f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:37.279980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83946979-ee71-4e13-b555-ee28f83b560f admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:37.281056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83946979-ee71-4e13-b555-ee28f83b560f admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:37.306711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83946979-ee71-4e13-b555-ee28f83b560f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:37.308205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 48/96] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:37 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:37.314284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced013e-f20e-419c-98af-ead549e4ecce admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:37.323749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced013e-f20e-419c-98af-ead549e4ecce admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:37.327660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba493aa-a7f2-44dd-a253-5b31cd4aa8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:37.328433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba493aa-a7f2-44dd-a253-5b31cd4aa8fc admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:37.328760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba493aa-a7f2-44dd-a253-5b31cd4aa8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:37.329654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba493aa-a7f2-44dd-a253-5b31cd4aa8fc admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:37.330926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba493aa-a7f2-44dd-a253-5b31cd4aa8fc admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:37.356339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba493aa-a7f2-44dd-a253-5b31cd4aa8fc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:37.357838 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 49/97] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:37 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:54:37.363455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83946979-ee71-4e13-b555-ee28f83b560f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:37.372752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83946979-ee71-4e13-b555-ee28f83b560f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:37.377301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f506b-c4b9-440f-bb6e-e7705ee7bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:37.378114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f506b-c4b9-440f-bb6e-e7705ee7bfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:37.378412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f506b-c4b9-440f-bb6e-e7705ee7bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:37.378741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f506b-c4b9-440f-bb6e-e7705ee7bfbb admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/users/35ed18ce25b9435aaf42d0a0ed7b1a41/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:37.380468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f506b-c4b9-440f-bb6e-e7705ee7bfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a7d1331b8144a19205ad2b0f3ce026, user_id=35ed18ce25b9435aaf42d0a0ed7b1a41, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:37.405464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-6a1f506b-c4b9-440f-bb6e-e7705ee7bfbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:54:37.405464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:54:37.405464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:54:37.407745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f506b-c4b9-440f-bb6e-e7705ee7bfbb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:37.421199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 49/98] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:54:37 2021] PUT /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/users/35ed18ce25b9435aaf42d0a0ed7b1a41/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:54:39.347878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d449ce-20b1-406d-b52d-1aefc42a722f None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:39.348381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d449ce-20b1-406d-b52d-1aefc42a722f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:39.348465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d449ce-20b1-406d-b52d-1aefc42a722f None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:39.350135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 50/99] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:39.355195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af6c3a-0783-4aa8-8484-3a9484dc73d1 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:39.355619 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af6c3a-0783-4aa8-8484-3a9484dc73d1 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:39.355788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af6c3a-0783-4aa8-8484-3a9484dc73d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:39.379164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-80af6c3a-0783-4aa8-8484-3a9484dc73d1 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:39.380289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-80af6c3a-0783-4aa8-8484-3a9484dc73d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:39.443566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 50/100] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:54:39.465822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d449ce-20b1-406d-b52d-1aefc42a722f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:39.477585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d449ce-20b1-406d-b52d-1aefc42a722f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:39.481410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8d57c-6c25-4a97-8f0f-16986802302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:39.482126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8d57c-6c25-4a97-8f0f-16986802302f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:39.482526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8d57c-6c25-4a97-8f0f-16986802302f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:39.483829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8d57c-6c25-4a97-8f0f-16986802302f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:39.497305 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8d57c-6c25-4a97-8f0f-16986802302f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:39.504342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-53f8d57c-6c25-4a97-8f0f-16986802302f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:54:39.505484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 51/101] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:54:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:39.511281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af6c3a-0783-4aa8-8484-3a9484dc73d1 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:39.520167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af6c3a-0783-4aa8-8484-3a9484dc73d1 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:39.524141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d0700-ecb9-437f-b5d9-f488adcbe13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:39.524738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d0700-ecb9-437f-b5d9-f488adcbe13c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:39.525034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d0700-ecb9-437f-b5d9-f488adcbe13c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:39.525324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d0700-ecb9-437f-b5d9-f488adcbe13c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:39.526044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d0700-ecb9-437f-b5d9-f488adcbe13c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:39.526351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d0700-ecb9-437f-b5d9-f488adcbe13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:39.552566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d0700-ecb9-437f-b5d9-f488adcbe13c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:39.561458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 51/102] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:39.567576 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8d57c-6c25-4a97-8f0f-16986802302f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:39.576977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8d57c-6c25-4a97-8f0f-16986802302f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:39.581118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d75af-b75e-4a29-bb91-2332b175e1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:39.581907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d75af-b75e-4a29-bb91-2332b175e1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:39.582202 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d75af-b75e-4a29-bb91-2332b175e1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:39.582487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d75af-b75e-4a29-bb91-2332b175e1f9 admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:39.583716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d75af-b75e-4a29-bb91-2332b175e1f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:39.609689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d75af-b75e-4a29-bb91-2332b175e1f9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:39.612322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 52/103] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:39 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:39.617564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d0700-ecb9-437f-b5d9-f488adcbe13c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:39.627039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d0700-ecb9-437f-b5d9-f488adcbe13c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:39.630977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50fda1-f17d-428e-a7c8-ca2a6d26c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:39.631551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50fda1-f17d-428e-a7c8-ca2a6d26c9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:39.631839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50fda1-f17d-428e-a7c8-ca2a6d26c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:39.632124 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50fda1-f17d-428e-a7c8-ca2a6d26c9a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:39.639627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50fda1-f17d-428e-a7c8-ca2a6d26c9a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:39.665205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50fda1-f17d-428e-a7c8-ca2a6d26c9a5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:39.674180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 52/104] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:54:39.679647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d75af-b75e-4a29-bb91-2332b175e1f9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:39.689144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d75af-b75e-4a29-bb91-2332b175e1f9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:39.693032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e131950-90ae-4fdc-b7a5-809ed7dcf9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:39.693808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e131950-90ae-4fdc-b7a5-809ed7dcf9ac admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:39.694105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e131950-90ae-4fdc-b7a5-809ed7dcf9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:39.694393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e131950-90ae-4fdc-b7a5-809ed7dcf9ac admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:39.695496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e131950-90ae-4fdc-b7a5-809ed7dcf9ac admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:39.721953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e131950-90ae-4fdc-b7a5-809ed7dcf9ac admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:39.723523 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 53/105] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:39 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:39.729043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50fda1-f17d-428e-a7c8-ca2a6d26c9a5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:39.739166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50fda1-f17d-428e-a7c8-ca2a6d26c9a5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:39.743155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baa991-3982-40c6-9fb5-edfb85350b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:39.743739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baa991-3982-40c6-9fb5-edfb85350b4c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:39.744034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baa991-3982-40c6-9fb5-edfb85350b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:39.744324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baa991-3982-40c6-9fb5-edfb85350b4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:39.745098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baa991-3982-40c6-9fb5-edfb85350b4c admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026, user.id=35ed18ce25b9435aaf42d0a0ed7b1a41) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:39.745408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baa991-3982-40c6-9fb5-edfb85350b4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:39.770668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baa991-3982-40c6-9fb5-edfb85350b4c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:39.776576 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 53/106] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:54:39 2021] GET /identity/v3/role_assignments?user.id=35ed18ce25b9435aaf42d0a0ed7b1a41&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:41.781713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10916338-34c1-4e7f-831b-378f8bb8cdff None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:41.782827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10916338-34c1-4e7f-831b-378f8bb8cdff None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:41.782930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10916338-34c1-4e7f-831b-378f8bb8cdff None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:41.784561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 54/107] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:41.789570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aca3b-d425-4b2e-8481-38a4bbcd2c2d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:41.789967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aca3b-d425-4b2e-8481-38a4bbcd2c2d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:41.790158 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aca3b-d425-4b2e-8481-38a4bbcd2c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:41.812774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c65aca3b-d425-4b2e-8481-38a4bbcd2c2d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:41.813953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c65aca3b-d425-4b2e-8481-38a4bbcd2c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:41.820629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 54/108] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:41.842310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10916338-34c1-4e7f-831b-378f8bb8cdff None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:41.854747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10916338-34c1-4e7f-831b-378f8bb8cdff None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:41.858543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430a3a5-877b-465b-b474-cd30f3ff2569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:41.859301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430a3a5-877b-465b-b474-cd30f3ff2569 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:41.859596 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430a3a5-877b-465b-b474-cd30f3ff2569 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:41.859885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430a3a5-877b-465b-b474-cd30f3ff2569 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:41.872119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430a3a5-877b-465b-b474-cd30f3ff2569 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:41.879134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-2430a3a5-877b-465b-b474-cd30f3ff2569 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:54:41.880248 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 55/109] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:54:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:41.885993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65aca3b-d425-4b2e-8481-38a4bbcd2c2d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:41.895972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65aca3b-d425-4b2e-8481-38a4bbcd2c2d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:41.899883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a725a-9007-4c2b-8992-a4bd988f48d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:41.900480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a725a-9007-4c2b-8992-a4bd988f48d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:41.900776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a725a-9007-4c2b-8992-a4bd988f48d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:41.901063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a725a-9007-4c2b-8992-a4bd988f48d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:41.901769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a725a-9007-4c2b-8992-a4bd988f48d6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:41.902073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a725a-9007-4c2b-8992-a4bd988f48d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:41.928182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a725a-9007-4c2b-8992-a4bd988f48d6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:41.936605 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 55/110] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:54:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:41.942340 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430a3a5-877b-465b-b474-cd30f3ff2569 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:41.952601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430a3a5-877b-465b-b474-cd30f3ff2569 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:41.956629 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610019a-be33-44ee-b467-d09be51d5730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:41.957418 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610019a-be33-44ee-b467-d09be51d5730 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:41.957714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610019a-be33-44ee-b467-d09be51d5730 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:41.958003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610019a-be33-44ee-b467-d09be51d5730 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:41.959123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610019a-be33-44ee-b467-d09be51d5730 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:41.986196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610019a-be33-44ee-b467-d09be51d5730 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:41.987726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 56/111] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:41 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:54:41.992974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a725a-9007-4c2b-8992-a4bd988f48d6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:42.002406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a725a-9007-4c2b-8992-a4bd988f48d6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:42.006256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e546d-fc73-4014-8df8-5ca0cc98c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:42.006858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e546d-fc73-4014-8df8-5ca0cc98c93f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:42.007156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e546d-fc73-4014-8df8-5ca0cc98c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:42.007443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e546d-fc73-4014-8df8-5ca0cc98c93f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:42.015265 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e546d-fc73-4014-8df8-5ca0cc98c93f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:42.041351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e546d-fc73-4014-8df8-5ca0cc98c93f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:42.050394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 56/112] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:54:42.055890 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610019a-be33-44ee-b467-d09be51d5730 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:42.065283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610019a-be33-44ee-b467-d09be51d5730 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:42.069244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e0b0f-7745-4ccf-a086-fee9ffa326ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:42.070021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e0b0f-7745-4ccf-a086-fee9ffa326ef admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:42.070321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e0b0f-7745-4ccf-a086-fee9ffa326ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:42.070614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e0b0f-7745-4ccf-a086-fee9ffa326ef admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:42.071716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e0b0f-7745-4ccf-a086-fee9ffa326ef admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:42.097672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e0b0f-7745-4ccf-a086-fee9ffa326ef admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:42.099218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 57/113] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:42 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:42.104583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e546d-fc73-4014-8df8-5ca0cc98c93f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:42.113853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e546d-fc73-4014-8df8-5ca0cc98c93f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:42.117813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47984b-f9f3-41d8-a234-ecf2a2625294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:42.118397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47984b-f9f3-41d8-a234-ecf2a2625294 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:42.118709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47984b-f9f3-41d8-a234-ecf2a2625294 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:42.118997 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47984b-f9f3-41d8-a234-ecf2a2625294 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:42.119764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47984b-f9f3-41d8-a234-ecf2a2625294 admin admin] RBAC: Adding query filter params (role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026, user.id=fbd81aca114b4057bcc77965ea8c47ba) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:42.120067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47984b-f9f3-41d8-a234-ecf2a2625294 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:42.145744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47984b-f9f3-41d8-a234-ecf2a2625294 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:42.151083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 57/114] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:54:42 2021] GET /identity/v3/role_assignments?user.id=fbd81aca114b4057bcc77965ea8c47ba&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:44.102752 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed0ae3-de38-44ab-8ced-cd9a1992e905 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:44.103283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed0ae3-de38-44ab-8ced-cd9a1992e905 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:44.103370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed0ae3-de38-44ab-8ced-cd9a1992e905 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:44.105010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 58/115] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:44.111262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc33ef-ff1c-46fd-be77-df99b4369029 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:44.111758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc33ef-ff1c-46fd-be77-df99b4369029 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:44.111844 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc33ef-ff1c-46fd-be77-df99b4369029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:44.133896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8abc33ef-ff1c-46fd-be77-df99b4369029 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:44.135081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8abc33ef-ff1c-46fd-be77-df99b4369029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:44.141556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 58/116] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:44.162960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed0ae3-de38-44ab-8ced-cd9a1992e905 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:44.175875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed0ae3-de38-44ab-8ced-cd9a1992e905 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:44.179735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f1913-6e68-42a9-9d4e-c385769f4ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:44.180473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f1913-6e68-42a9-9d4e-c385769f4ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:44.180773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f1913-6e68-42a9-9d4e-c385769f4ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:44.181064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f1913-6e68-42a9-9d4e-c385769f4ca9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:44.194155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f1913-6e68-42a9-9d4e-c385769f4ca9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:44.203745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-6b7f1913-6e68-42a9-9d4e-c385769f4ca9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:54:44.204880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 59/117] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:54:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:54:44.210788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc33ef-ff1c-46fd-be77-df99b4369029 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:44.220008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc33ef-ff1c-46fd-be77-df99b4369029 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:44.224067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1e0b-092f-4532-a618-5c5fb6fcdeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:44.224664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1e0b-092f-4532-a618-5c5fb6fcdeae admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:44.224959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1e0b-092f-4532-a618-5c5fb6fcdeae admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:44.225250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1e0b-092f-4532-a618-5c5fb6fcdeae admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:44.225950 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f1e0b-092f-4532-a618-5c5fb6fcdeae admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:44.226250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f1e0b-092f-4532-a618-5c5fb6fcdeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:44.252084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f1e0b-092f-4532-a618-5c5fb6fcdeae admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:44.260482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 59/118] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:54:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:54:44.265845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f1913-6e68-42a9-9d4e-c385769f4ca9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:44.276638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f1913-6e68-42a9-9d4e-c385769f4ca9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:44.280560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915ee4b-d1e8-43eb-bc60-1df8be2d83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:44.281351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915ee4b-d1e8-43eb-bc60-1df8be2d83c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:44.281649 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915ee4b-d1e8-43eb-bc60-1df8be2d83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:44.282674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915ee4b-d1e8-43eb-bc60-1df8be2d83c4 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:44.283843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915ee4b-d1e8-43eb-bc60-1df8be2d83c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:44.309818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915ee4b-d1e8-43eb-bc60-1df8be2d83c4 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:44.311336 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 60/119] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:44 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:44.316770 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1e0b-092f-4532-a618-5c5fb6fcdeae admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:44.326087 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1e0b-092f-4532-a618-5c5fb6fcdeae admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:44.330210 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2bcdf-771f-46f7-9d58-7b1cb6876d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:44.331027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2bcdf-771f-46f7-9d58-7b1cb6876d88 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:44.331322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2bcdf-771f-46f7-9d58-7b1cb6876d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:44.331611 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2bcdf-771f-46f7-9d58-7b1cb6876d88 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:44.332688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2bcdf-771f-46f7-9d58-7b1cb6876d88 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:44.358673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2bcdf-771f-46f7-9d58-7b1cb6876d88 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:44.361311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 60/120] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:44 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:54:44.366584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915ee4b-d1e8-43eb-bc60-1df8be2d83c4 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:44.375897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915ee4b-d1e8-43eb-bc60-1df8be2d83c4 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:44.379769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4920e-173f-4667-a8d9-670857e6f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:44.380578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4920e-173f-4667-a8d9-670857e6f7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:44.380872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4920e-173f-4667-a8d9-670857e6f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:44.381160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4920e-173f-4667-a8d9-670857e6f7b8 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/users/fbd81aca114b4057bcc77965ea8c47ba/roles/886f966104ce425fa75dbe7ee88aba33` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:44.383115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4920e-173f-4667-a8d9-670857e6f7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a7d1331b8144a19205ad2b0f3ce026, user_id=fbd81aca114b4057bcc77965ea8c47ba, role_id=886f966104ce425fa75dbe7ee88aba33)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:44.410061 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4920e-173f-4667-a8d9-670857e6f7b8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:44.423058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 61/121] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:54:44 2021] PUT /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/users/fbd81aca114b4057bcc77965ea8c47ba/roles/886f966104ce425fa75dbe7ee88aba33 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:54:46.354316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aaddf-1ddb-4630-969f-ba119216266d None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:46.354847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aaddf-1ddb-4630-969f-ba119216266d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:46.354928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aaddf-1ddb-4630-969f-ba119216266d None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:46.356713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 61/122] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:46.362334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362da4-84f8-4a38-a576-b5ea5a05cb14 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:46.362780 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362da4-84f8-4a38-a576-b5ea5a05cb14 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:46.362955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362da4-84f8-4a38-a576-b5ea5a05cb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:46.385656 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-75362da4-84f8-4a38-a576-b5ea5a05cb14 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:46.386818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-75362da4-84f8-4a38-a576-b5ea5a05cb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:46.450346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 62/123] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:46.473309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aaddf-1ddb-4630-969f-ba119216266d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:46.484689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aaddf-1ddb-4630-969f-ba119216266d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:46.488810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff1224-5396-42f6-8b15-b224f04e27f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:46.489534 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff1224-5396-42f6-8b15-b224f04e27f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:46.489828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff1224-5396-42f6-8b15-b224f04e27f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:46.490111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff1224-5396-42f6-8b15-b224f04e27f6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:46.502392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff1224-5396-42f6-8b15-b224f04e27f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:46.509163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-2aff1224-5396-42f6-8b15-b224f04e27f6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:54:46.510266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 62/124] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:54:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:46.516072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75362da4-84f8-4a38-a576-b5ea5a05cb14 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:46.525437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75362da4-84f8-4a38-a576-b5ea5a05cb14 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:46.529444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bafcb-c4dc-40e0-b302-29c48cfd4a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:46.530043 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bafcb-c4dc-40e0-b302-29c48cfd4a8c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:46.530339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bafcb-c4dc-40e0-b302-29c48cfd4a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:46.530654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bafcb-c4dc-40e0-b302-29c48cfd4a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:46.531369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bafcb-c4dc-40e0-b302-29c48cfd4a8c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:46.531692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bafcb-c4dc-40e0-b302-29c48cfd4a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:46.557482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bafcb-c4dc-40e0-b302-29c48cfd4a8c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:46.566692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 63/125] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:54:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:46.572540 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff1224-5396-42f6-8b15-b224f04e27f6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:46.582380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff1224-5396-42f6-8b15-b224f04e27f6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:46.586393 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099bb59-a6e3-4ea1-af82-927e6ad0c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:46.587223 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099bb59-a6e3-4ea1-af82-927e6ad0c1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:46.587520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099bb59-a6e3-4ea1-af82-927e6ad0c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:46.587812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099bb59-a6e3-4ea1-af82-927e6ad0c1a1 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:46.588896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099bb59-a6e3-4ea1-af82-927e6ad0c1a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:46.614862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099bb59-a6e3-4ea1-af82-927e6ad0c1a1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:46.616258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 63/126] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:46 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:46.621586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bafcb-c4dc-40e0-b302-29c48cfd4a8c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:46.631502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bafcb-c4dc-40e0-b302-29c48cfd4a8c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:46.635438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d75031-3aa3-4967-b491-e58ae407661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:46.636008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d75031-3aa3-4967-b491-e58ae407661d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:46.636302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d75031-3aa3-4967-b491-e58ae407661d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:46.636590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d75031-3aa3-4967-b491-e58ae407661d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:46.644889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d75031-3aa3-4967-b491-e58ae407661d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:46.669931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d75031-3aa3-4967-b491-e58ae407661d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:46.678938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 64/127] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:54:46.684330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099bb59-a6e3-4ea1-af82-927e6ad0c1a1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:46.694092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099bb59-a6e3-4ea1-af82-927e6ad0c1a1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:46.697977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52218757-934f-41bb-9b11-fc254f19d747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:46.698795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52218757-934f-41bb-9b11-fc254f19d747 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:46.699094 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52218757-934f-41bb-9b11-fc254f19d747 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:46.699385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52218757-934f-41bb-9b11-fc254f19d747 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:46.700449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52218757-934f-41bb-9b11-fc254f19d747 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:46.726333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52218757-934f-41bb-9b11-fc254f19d747 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:46.727878 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 64/128] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:46 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:46.733360 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d75031-3aa3-4967-b491-e58ae407661d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:46.742912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d75031-3aa3-4967-b491-e58ae407661d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:46.746885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae335345-feaf-4ca8-a95a-2c828da17b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:46.747469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae335345-feaf-4ca8-a95a-2c828da17b30 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:46.747769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae335345-feaf-4ca8-a95a-2c828da17b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:46.748066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae335345-feaf-4ca8-a95a-2c828da17b30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:46.748836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae335345-feaf-4ca8-a95a-2c828da17b30 admin admin] RBAC: Adding query filter params (role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026, user.id=fbd81aca114b4057bcc77965ea8c47ba) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:46.749148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae335345-feaf-4ca8-a95a-2c828da17b30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:46.775045 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae335345-feaf-4ca8-a95a-2c828da17b30 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:46.780867 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 65/129] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:54:46 2021] GET /identity/v3/role_assignments?user.id=fbd81aca114b4057bcc77965ea8c47ba&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:48.787634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5704c-1ed2-4713-8ce4-a2e21d9cdbb2 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:48.788177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5704c-1ed2-4713-8ce4-a2e21d9cdbb2 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:48.788293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5704c-1ed2-4713-8ce4-a2e21d9cdbb2 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:48.789886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 65/130] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:48.795082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c674-06d4-4366-b835-4a83e95a0074 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:48.795506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c674-06d4-4366-b835-4a83e95a0074 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:48.795681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c674-06d4-4366-b835-4a83e95a0074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:48.820718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-aa85c674-06d4-4366-b835-4a83e95a0074 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:48.821990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-aa85c674-06d4-4366-b835-4a83e95a0074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:48.829378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 66/131] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:48.851128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5704c-1ed2-4713-8ce4-a2e21d9cdbb2 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:48.863040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5704c-1ed2-4713-8ce4-a2e21d9cdbb2 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:48.866897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc54d47-15f1-4328-abc3-80d51ef53d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:48.867623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc54d47-15f1-4328-abc3-80d51ef53d18 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:48.867959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc54d47-15f1-4328-abc3-80d51ef53d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:48.868251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc54d47-15f1-4328-abc3-80d51ef53d18 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:48.880871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc54d47-15f1-4328-abc3-80d51ef53d18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:48.887143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-2dc54d47-15f1-4328-abc3-80d51ef53d18 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:54:48.888255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 66/132] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:48.894735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c674-06d4-4366-b835-4a83e95a0074 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:48.903269 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c674-06d4-4366-b835-4a83e95a0074 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:48.907469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b052d68-3968-46d5-bad8-35a0ffc72e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:48.908058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b052d68-3968-46d5-bad8-35a0ffc72e82 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:48.908346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b052d68-3968-46d5-bad8-35a0ffc72e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:48.908630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b052d68-3968-46d5-bad8-35a0ffc72e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:48.909335 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b052d68-3968-46d5-bad8-35a0ffc72e82 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:48.909628 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b052d68-3968-46d5-bad8-35a0ffc72e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:48.935080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b052d68-3968-46d5-bad8-35a0ffc72e82 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:48.944265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 67/133] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:54:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:48.950154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc54d47-15f1-4328-abc3-80d51ef53d18 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:48.960712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc54d47-15f1-4328-abc3-80d51ef53d18 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:48.964561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0470e5-56e8-4a73-83b7-ed0cd02d3a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:48.965348 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0470e5-56e8-4a73-83b7-ed0cd02d3a06 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:48.965643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0470e5-56e8-4a73-83b7-ed0cd02d3a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:48.965927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0470e5-56e8-4a73-83b7-ed0cd02d3a06 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:48.967032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0470e5-56e8-4a73-83b7-ed0cd02d3a06 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:48.993180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0470e5-56e8-4a73-83b7-ed0cd02d3a06 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:48.994694 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 67/134] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:48 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:49.000046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b052d68-3968-46d5-bad8-35a0ffc72e82 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:49.010206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b052d68-3968-46d5-bad8-35a0ffc72e82 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:49.014248 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563e693-c7cf-4f07-b20a-3a706566e8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:49.014855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563e693-c7cf-4f07-b20a-3a706566e8bf admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:49.015148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563e693-c7cf-4f07-b20a-3a706566e8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:49.015437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563e693-c7cf-4f07-b20a-3a706566e8bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:49.023210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563e693-c7cf-4f07-b20a-3a706566e8bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:49.049447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563e693-c7cf-4f07-b20a-3a706566e8bf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:49.057806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 68/135] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:54:49.063507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0470e5-56e8-4a73-83b7-ed0cd02d3a06 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:49.072884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0470e5-56e8-4a73-83b7-ed0cd02d3a06 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:49.076781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e7a55-919c-490d-9e83-f54f40dab985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:49.077560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e7a55-919c-490d-9e83-f54f40dab985 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:49.077854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e7a55-919c-490d-9e83-f54f40dab985 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:49.078141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e7a55-919c-490d-9e83-f54f40dab985 admin admin] PATH_INFO: `/v3/projects/e11bda8910464a189779d5093f615c5c` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:49.079744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e7a55-919c-490d-9e83-f54f40dab985 admin admin] RBAC: Authorizing `identity:get_project(project_id=e11bda8910464a189779d5093f615c5c)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:49.105645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e7a55-919c-490d-9e83-f54f40dab985 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:49.107196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 68/136] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:49 2021] GET /identity/v3/projects/e11bda8910464a189779d5093f615c5c => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:49.113186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563e693-c7cf-4f07-b20a-3a706566e8bf admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:49.121742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563e693-c7cf-4f07-b20a-3a706566e8bf admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:49.125792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c725a-4fd1-4ee1-87e8-bf855b8e84b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:49.126374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c725a-4fd1-4ee1-87e8-bf855b8e84b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:49.126714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c725a-4fd1-4ee1-87e8-bf855b8e84b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:49.127014 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c725a-4fd1-4ee1-87e8-bf855b8e84b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:49.127794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c725a-4fd1-4ee1-87e8-bf855b8e84b5 admin admin] RBAC: Adding query filter params (role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=e11bda8910464a189779d5093f615c5c, user.id=fbd81aca114b4057bcc77965ea8c47ba) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:49.128106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c725a-4fd1-4ee1-87e8-bf855b8e84b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:49.154668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c725a-4fd1-4ee1-87e8-bf855b8e84b5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:49.161378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 69/137] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:54:49 2021] GET /identity/v3/role_assignments?user.id=fbd81aca114b4057bcc77965ea8c47ba&scope.project.id=e11bda8910464a189779d5093f615c5c&role.id=871d3e9701f04be1906b8ef20b10077b => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:51.129119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5f0fd-3ad9-4d31-8c64-6ab646010bc8 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:51.129631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5f0fd-3ad9-4d31-8c64-6ab646010bc8 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:51.129743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5f0fd-3ad9-4d31-8c64-6ab646010bc8 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:51.131394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 69/138] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:51.136829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82a273-4e21-49cc-82ce-422ad7beb63f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:51.137249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82a273-4e21-49cc-82ce-422ad7beb63f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:51.137412 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82a273-4e21-49cc-82ce-422ad7beb63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:51.161354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5c82a273-4e21-49cc-82ce-422ad7beb63f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:51.162499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5c82a273-4e21-49cc-82ce-422ad7beb63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:51.169279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 70/139] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:51.191428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5f0fd-3ad9-4d31-8c64-6ab646010bc8 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:51.203081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5f0fd-3ad9-4d31-8c64-6ab646010bc8 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:51.207772 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349dd25-809d-4ece-b127-9c8050bb1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:51.208502 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349dd25-809d-4ece-b127-9c8050bb1fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:51.208800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349dd25-809d-4ece-b127-9c8050bb1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:51.209086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349dd25-809d-4ece-b127-9c8050bb1fa4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:51.221027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349dd25-809d-4ece-b127-9c8050bb1fa4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:51.227381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-7349dd25-809d-4ece-b127-9c8050bb1fa4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:54:51.228497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 70/140] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:51.235982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82a273-4e21-49cc-82ce-422ad7beb63f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:51.245632 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82a273-4e21-49cc-82ce-422ad7beb63f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:51.249602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb64cc-39ee-47e4-acb6-457e6a40a2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:51.250204 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb64cc-39ee-47e4-acb6-457e6a40a2dd admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:51.250685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb64cc-39ee-47e4-acb6-457e6a40a2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:51.250989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb64cc-39ee-47e4-acb6-457e6a40a2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:51.251711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb64cc-39ee-47e4-acb6-457e6a40a2dd admin admin] RBAC: Adding query filter params (name=member) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:51.252010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb64cc-39ee-47e4-acb6-457e6a40a2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:51.277444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb64cc-39ee-47e4-acb6-457e6a40a2dd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:51.287208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 71/141] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:54:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:51.292885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349dd25-809d-4ece-b127-9c8050bb1fa4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:51.303766 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349dd25-809d-4ece-b127-9c8050bb1fa4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:51.307851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091923-7728-4c4e-bf14-223c02af3f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:51.308671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091923-7728-4c4e-bf14-223c02af3f31 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:51.308969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091923-7728-4c4e-bf14-223c02af3f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:51.309259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091923-7728-4c4e-bf14-223c02af3f31 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:51.310387 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091923-7728-4c4e-bf14-223c02af3f31 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:51.339342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091923-7728-4c4e-bf14-223c02af3f31 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:51.341007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 71/142] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:51 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:51.347242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb64cc-39ee-47e4-acb6-457e6a40a2dd admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:51.356805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb64cc-39ee-47e4-acb6-457e6a40a2dd admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:51.361251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27cc3-6174-4749-9b69-b900eb539994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:51.362025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27cc3-6174-4749-9b69-b900eb539994 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:51.362314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27cc3-6174-4749-9b69-b900eb539994 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:51.362594 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27cc3-6174-4749-9b69-b900eb539994 admin admin] PATH_INFO: `/v3/projects/e11bda8910464a189779d5093f615c5c` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:51.363686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27cc3-6174-4749-9b69-b900eb539994 admin admin] RBAC: Authorizing `identity:get_project(project_id=e11bda8910464a189779d5093f615c5c)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:51.389267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27cc3-6174-4749-9b69-b900eb539994 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:51.390871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 72/143] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:51 2021] GET /identity/v3/projects/e11bda8910464a189779d5093f615c5c => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:51.397088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091923-7728-4c4e-bf14-223c02af3f31 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:51.407471 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091923-7728-4c4e-bf14-223c02af3f31 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:51.411584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbb5a4-7fd0-419d-9c85-6b1b4ff5dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:51.412396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbb5a4-7fd0-419d-9c85-6b1b4ff5dcfa admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:51.412685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbb5a4-7fd0-419d-9c85-6b1b4ff5dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:51.412966 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbb5a4-7fd0-419d-9c85-6b1b4ff5dcfa admin admin] PATH_INFO: `/v3/projects/e11bda8910464a189779d5093f615c5c/users/fbd81aca114b4057bcc77965ea8c47ba/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:51.414742 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbb5a4-7fd0-419d-9c85-6b1b4ff5dcfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11bda8910464a189779d5093f615c5c, user_id=fbd81aca114b4057bcc77965ea8c47ba, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:51.440895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbb5a4-7fd0-419d-9c85-6b1b4ff5dcfa admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:51.453287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 72/144] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:54:51 2021] PUT /identity/v3/projects/e11bda8910464a189779d5093f615c5c/users/fbd81aca114b4057bcc77965ea8c47ba/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:54:53.421313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54035ac-2e38-41f7-8b4e-9c2c09e79b59 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:53.421877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54035ac-2e38-41f7-8b4e-9c2c09e79b59 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:53.421877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54035ac-2e38-41f7-8b4e-9c2c09e79b59 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:53.423617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 73/145] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:53.428751 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8beac-1dc1-4819-a268-ddb9a9546d02 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:53.429168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8beac-1dc1-4819-a268-ddb9a9546d02 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:53.429336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8beac-1dc1-4819-a268-ddb9a9546d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:53.451293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-10b8beac-1dc1-4819-a268-ddb9a9546d02 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:53.452463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-10b8beac-1dc1-4819-a268-ddb9a9546d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:53.517744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 73/146] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:53.540634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54035ac-2e38-41f7-8b4e-9c2c09e79b59 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:53.552294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54035ac-2e38-41f7-8b4e-9c2c09e79b59 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:53.556158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b33b4f-e84a-4459-be4a-017255205004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:53.556883 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b33b4f-e84a-4459-be4a-017255205004 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:53.557180 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b33b4f-e84a-4459-be4a-017255205004 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:53.557468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b33b4f-e84a-4459-be4a-017255205004 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:53.569664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b33b4f-e84a-4459-be4a-017255205004 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:54:53.576466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-86b33b4f-e84a-4459-be4a-017255205004 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:54:53.577556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 74/147] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:54:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:54:53.583688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8beac-1dc1-4819-a268-ddb9a9546d02 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:53.592204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8beac-1dc1-4819-a268-ddb9a9546d02 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:53.597238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c6cd-ab21-4c12-86f3-ffb893222088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:53.597833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c6cd-ab21-4c12-86f3-ffb893222088 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:53.598133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c6cd-ab21-4c12-86f3-ffb893222088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:53.598425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c6cd-ab21-4c12-86f3-ffb893222088 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:53.599172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c6cd-ab21-4c12-86f3-ffb893222088 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:53.599479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c6cd-ab21-4c12-86f3-ffb893222088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:53.624728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c6cd-ab21-4c12-86f3-ffb893222088 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:53.633636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 74/148] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:54:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:53.639390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b33b4f-e84a-4459-be4a-017255205004 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:53.649068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b33b4f-e84a-4459-be4a-017255205004 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:53.652930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4225fc8-4d41-40b2-a0b4-d35211ca8c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:53.653713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4225fc8-4d41-40b2-a0b4-d35211ca8c37 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:53.654003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4225fc8-4d41-40b2-a0b4-d35211ca8c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:53.654283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4225fc8-4d41-40b2-a0b4-d35211ca8c37 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:53.655385 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4225fc8-4d41-40b2-a0b4-d35211ca8c37 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:53.681381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4225fc8-4d41-40b2-a0b4-d35211ca8c37 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:53.682850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 75/149] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:54:53 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:53.690140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c6cd-ab21-4c12-86f3-ffb893222088 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:53.699939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c6cd-ab21-4c12-86f3-ffb893222088 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:53.704581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e55e0-f993-4633-bc91-471fd5499dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:53.705157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e55e0-f993-4633-bc91-471fd5499dda admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:53.705445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e55e0-f993-4633-bc91-471fd5499dda admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:53.705731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e55e0-f993-4633-bc91-471fd5499dda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:53.713322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e55e0-f993-4633-bc91-471fd5499dda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:53.739896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e55e0-f993-4633-bc91-471fd5499dda admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:53.748504 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 75/150] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:54:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:54:53.754531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4225fc8-4d41-40b2-a0b4-d35211ca8c37 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:53.763834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4225fc8-4d41-40b2-a0b4-d35211ca8c37 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:53.768439 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262e8d0-93f6-422f-9d76-b83a1eeb60c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:53.769223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262e8d0-93f6-422f-9d76-b83a1eeb60c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:53.769522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262e8d0-93f6-422f-9d76-b83a1eeb60c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:53.769814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262e8d0-93f6-422f-9d76-b83a1eeb60c9 admin admin] PATH_INFO: `/v3/projects/e11bda8910464a189779d5093f615c5c` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:53.770924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262e8d0-93f6-422f-9d76-b83a1eeb60c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=e11bda8910464a189779d5093f615c5c)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:53.796782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262e8d0-93f6-422f-9d76-b83a1eeb60c9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:53.798437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 76/151] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:54:53 2021] GET /identity/v3/projects/e11bda8910464a189779d5093f615c5c => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:53.804105 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e55e0-f993-4633-bc91-471fd5499dda admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:53.813240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e55e0-f993-4633-bc91-471fd5499dda admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:53.825500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccd1d0-d1b7-4b4a-8545-5de05f8410be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:53.826115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccd1d0-d1b7-4b4a-8545-5de05f8410be admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:53.826410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccd1d0-d1b7-4b4a-8545-5de05f8410be admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:53.826733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccd1d0-d1b7-4b4a-8545-5de05f8410be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:53.827524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccd1d0-d1b7-4b4a-8545-5de05f8410be admin admin] RBAC: Adding query filter params (role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=e11bda8910464a189779d5093f615c5c, user.id=fbd81aca114b4057bcc77965ea8c47ba) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:54:53.827839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccd1d0-d1b7-4b4a-8545-5de05f8410be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:53.853932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccd1d0-d1b7-4b4a-8545-5de05f8410be admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:53.860341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 76/152] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:54:53 2021] GET /identity/v3/role_assignments?user.id=fbd81aca114b4057bcc77965ea8c47ba&scope.project.id=e11bda8910464a189779d5093f615c5c&role.id=871d3e9701f04be1906b8ef20b10077b => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:55.884294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729f15-7fc3-4bc2-b33c-4812fbf41f91 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:55.884814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729f15-7fc3-4bc2-b33c-4812fbf41f91 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:55.884899 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729f15-7fc3-4bc2-b33c-4812fbf41f91 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:55.886549 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 77/153] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:55.891758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9839f-c478-4f6d-8328-28e062cd3658 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:55.892166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9839f-c478-4f6d-8328-28e062cd3658 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:55.892339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9839f-c478-4f6d-8328-28e062cd3658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:55.914597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-31e9839f-c478-4f6d-8328-28e062cd3658 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:55.915787 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-31e9839f-c478-4f6d-8328-28e062cd3658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:55.923088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 77/154] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:55.945322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d729f15-7fc3-4bc2-b33c-4812fbf41f91 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:55.957125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d729f15-7fc3-4bc2-b33c-4812fbf41f91 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:55.961034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5f45f-da5c-4ecb-926a-2bf4c8cdbb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:55.961790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5f45f-da5c-4ecb-926a-2bf4c8cdbb9f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:55.962085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5f45f-da5c-4ecb-926a-2bf4c8cdbb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:55.962372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5f45f-da5c-4ecb-926a-2bf4c8cdbb9f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:55.963524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5f45f-da5c-4ecb-926a-2bf4c8cdbb9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:55.990227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5f45f-da5c-4ecb-926a-2bf4c8cdbb9f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:55.992123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 78/155] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:55.997845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9839f-c478-4f6d-8328-28e062cd3658 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:56.007135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9839f-c478-4f6d-8328-28e062cd3658 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:56.011044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab542ad7-7e6c-430c-87ac-523d761b0b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:56.011643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542ad7-7e6c-430c-87ac-523d761b0b6b admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:56.011926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542ad7-7e6c-430c-87ac-523d761b0b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:56.012214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542ad7-7e6c-430c-87ac-523d761b0b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:56.012861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab542ad7-7e6c-430c-87ac-523d761b0b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:56.038754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab542ad7-7e6c-430c-87ac-523d761b0b6b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:56.064612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 78/156] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:54:55 2021] POST /identity/v3/projects => generated 302 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:54:58.066523 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b788fe-b9ba-4dfc-96dc-5cf77ff0951b None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:58.067054 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b788fe-b9ba-4dfc-96dc-5cf77ff0951b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:58.067168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b788fe-b9ba-4dfc-96dc-5cf77ff0951b None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:58.068802 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 79/157] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:54:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:54:58.073851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd917cf-23f0-413b-aa7f-a7e74bead132 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:58.074224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd917cf-23f0-413b-aa7f-a7e74bead132 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:58.074439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd917cf-23f0-413b-aa7f-a7e74bead132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:58.097291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-edd917cf-23f0-413b-aa7f-a7e74bead132 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:54:58.098433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-edd917cf-23f0-413b-aa7f-a7e74bead132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:54:58.161623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 79/158] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:54:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:54:58.184405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b788fe-b9ba-4dfc-96dc-5cf77ff0951b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:58.196031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b788fe-b9ba-4dfc-96dc-5cf77ff0951b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:58.199795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8364b28-e255-4eab-af61-a273eb43c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:58.200508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8364b28-e255-4eab-af61-a273eb43c017 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:58.200804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8364b28-e255-4eab-af61-a273eb43c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:58.201092 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8364b28-e255-4eab-af61-a273eb43c017 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:58.202138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8364b28-e255-4eab-af61-a273eb43c017 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:58.228343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8364b28-e255-4eab-af61-a273eb43c017 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:58.229762 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 80/159] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:54:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:54:58.235065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd917cf-23f0-413b-aa7f-a7e74bead132 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:54:58.244147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd917cf-23f0-413b-aa7f-a7e74bead132 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:54:58.248042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fb044-29dd-4964-a719-03b1885ca739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:54:58.248638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fb044-29dd-4964-a719-03b1885ca739 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:54:58.248931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fb044-29dd-4964-a719-03b1885ca739 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:54:58.249220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fb044-29dd-4964-a719-03b1885ca739 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:54:58.249877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fb044-29dd-4964-a719-03b1885ca739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:54:58.276631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fb044-29dd-4964-a719-03b1885ca739 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:54:58.295169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 80/160] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:54:58 2021] POST /identity/v3/users => generated 283 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:55:00.293627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6d0a6-fec6-4143-8f98-db982ad2d180 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:00.294125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6d0a6-fec6-4143-8f98-db982ad2d180 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:00.294125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6d0a6-fec6-4143-8f98-db982ad2d180 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:00.295915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 81/161] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:00.301529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97da943-2f24-416b-a8cf-3c10ea7d32d5 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:00.301946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97da943-2f24-416b-a8cf-3c10ea7d32d5 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:00.302115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97da943-2f24-416b-a8cf-3c10ea7d32d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:00.324988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-e97da943-2f24-416b-a8cf-3c10ea7d32d5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:00.326118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e97da943-2f24-416b-a8cf-3c10ea7d32d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:00.333007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 81/162] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:00.354148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6d0a6-fec6-4143-8f98-db982ad2d180 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:00.366539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6d0a6-fec6-4143-8f98-db982ad2d180 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:00.370307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9171d5-7f78-48e5-945c-6bf9fdbfc2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:00.371045 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9171d5-7f78-48e5-945c-6bf9fdbfc2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:00.371334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9171d5-7f78-48e5-945c-6bf9fdbfc2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:00.371618 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9171d5-7f78-48e5-945c-6bf9fdbfc2d5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:00.383943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9171d5-7f78-48e5-945c-6bf9fdbfc2d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:00.390158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-7b9171d5-7f78-48e5-945c-6bf9fdbfc2d5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:55:00.391245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 82/163] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:00.396737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97da943-2f24-416b-a8cf-3c10ea7d32d5 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:00.405514 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97da943-2f24-416b-a8cf-3c10ea7d32d5 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:00.409728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3efa54-8b3f-4b41-b821-af2746f9fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:00.410324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3efa54-8b3f-4b41-b821-af2746f9fbcd admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:00.410643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3efa54-8b3f-4b41-b821-af2746f9fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:00.410936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3efa54-8b3f-4b41-b821-af2746f9fbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:00.411652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3efa54-8b3f-4b41-b821-af2746f9fbcd admin admin] RBAC: Adding query filter params (name=member) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:00.411957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3efa54-8b3f-4b41-b821-af2746f9fbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:00.438853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3efa54-8b3f-4b41-b821-af2746f9fbcd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:00.447722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 82/164] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:55:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:00.453257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9171d5-7f78-48e5-945c-6bf9fdbfc2d5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:00.462543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9171d5-7f78-48e5-945c-6bf9fdbfc2d5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:00.466480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267c99-4b73-41d6-8f01-6cdb61e81e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:00.467298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267c99-4b73-41d6-8f01-6cdb61e81e79 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:00.467599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267c99-4b73-41d6-8f01-6cdb61e81e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:00.467887 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267c99-4b73-41d6-8f01-6cdb61e81e79 admin admin] PATH_INFO: `/v3/users/ad23da8435de4197b014b33efda92485` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:00.487457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267c99-4b73-41d6-8f01-6cdb61e81e79 admin admin] RBAC: Authorizing `identity:get_user(user_id=ad23da8435de4197b014b33efda92485)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:00.513848 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267c99-4b73-41d6-8f01-6cdb61e81e79 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:00.515373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 83/165] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:55:00 2021] GET /identity/v3/users/ad23da8435de4197b014b33efda92485 => generated 283 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:00.520849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3efa54-8b3f-4b41-b821-af2746f9fbcd admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:00.530107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3efa54-8b3f-4b41-b821-af2746f9fbcd admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:00.534808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2da31-d045-4325-b4ad-f55dbabc55d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:00.535378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2da31-d045-4325-b4ad-f55dbabc55d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:00.535668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2da31-d045-4325-b4ad-f55dbabc55d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:00.535951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2da31-d045-4325-b4ad-f55dbabc55d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:00.543467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2da31-d045-4325-b4ad-f55dbabc55d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:00.569935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2da31-d045-4325-b4ad-f55dbabc55d8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:00.578282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 83/166] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:00.583636 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267c99-4b73-41d6-8f01-6cdb61e81e79 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:00.592787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267c99-4b73-41d6-8f01-6cdb61e81e79 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:00.597287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759047bb-432d-4aa0-a3a0-30fff35eeee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:00.598166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759047bb-432d-4aa0-a3a0-30fff35eeee2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:00.598463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759047bb-432d-4aa0-a3a0-30fff35eeee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:00.598791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759047bb-432d-4aa0-a3a0-30fff35eeee2 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:00.599848 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759047bb-432d-4aa0-a3a0-30fff35eeee2 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:00.625980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759047bb-432d-4aa0-a3a0-30fff35eeee2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:00.627825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 84/167] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:00 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:00.633188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2da31-d045-4325-b4ad-f55dbabc55d8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:00.641557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2da31-d045-4325-b4ad-f55dbabc55d8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:00.645659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3ecd-bfd0-41d0-98bd-762cb9beaa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:00.646231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3ecd-bfd0-41d0-98bd-762cb9beaa9c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:00.646519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3ecd-bfd0-41d0-98bd-762cb9beaa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:00.646838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3ecd-bfd0-41d0-98bd-762cb9beaa9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:00.647596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3ecd-bfd0-41d0-98bd-762cb9beaa9c admin admin] RBAC: Adding query filter params (role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=833020c6e97d4c80bbe449fc92e597a4, user.id=ad23da8435de4197b014b33efda92485) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:00.647904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3ecd-bfd0-41d0-98bd-762cb9beaa9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:00.674728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3ecd-bfd0-41d0-98bd-762cb9beaa9c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:00.680334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 84/168] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:55:00 2021] GET /identity/v3/role_assignments?user.id=ad23da8435de4197b014b33efda92485&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=871d3e9701f04be1906b8ef20b10077b => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:02.601775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deab65-f710-44fd-9705-f1ef4e132244 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:02.602389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deab65-f710-44fd-9705-f1ef4e132244 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:02.602389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deab65-f710-44fd-9705-f1ef4e132244 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:02.604035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 85/169] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:02.609149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4b14-4dd4-4ad3-be5e-c740385b1bbf None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:02.609602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4b14-4dd4-4ad3-be5e-c740385b1bbf None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:02.609729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4b14-4dd4-4ad3-be5e-c740385b1bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:02.633166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-4bcd4b14-4dd4-4ad3-be5e-c740385b1bbf None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:02.634286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4bcd4b14-4dd4-4ad3-be5e-c740385b1bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:02.640905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 85/170] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:02.662156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deab65-f710-44fd-9705-f1ef4e132244 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:02.674333 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deab65-f710-44fd-9705-f1ef4e132244 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:02.678199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9c8d-d439-4914-a6c7-5515750343c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:02.678945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9c8d-d439-4914-a6c7-5515750343c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:02.679280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9c8d-d439-4914-a6c7-5515750343c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:02.679571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9c8d-d439-4914-a6c7-5515750343c1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:02.691343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb9c8d-d439-4914-a6c7-5515750343c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:02.697616 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-25eb9c8d-d439-4914-a6c7-5515750343c1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:55:02.698709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 86/171] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:02.704202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4b14-4dd4-4ad3-be5e-c740385b1bbf None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:02.712786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4b14-4dd4-4ad3-be5e-c740385b1bbf None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:02.716633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148d20a-5b8b-4eaa-a250-59012193ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:02.717230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148d20a-5b8b-4eaa-a250-59012193ff0c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:02.717520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148d20a-5b8b-4eaa-a250-59012193ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:02.717803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148d20a-5b8b-4eaa-a250-59012193ff0c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:02.718509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148d20a-5b8b-4eaa-a250-59012193ff0c admin admin] RBAC: Adding query filter params (name=member) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:02.718843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148d20a-5b8b-4eaa-a250-59012193ff0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:02.744811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148d20a-5b8b-4eaa-a250-59012193ff0c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:02.753369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 86/172] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:55:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:02.758676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9c8d-d439-4914-a6c7-5515750343c1 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:02.768890 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9c8d-d439-4914-a6c7-5515750343c1 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:02.772812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c673-200e-491e-b84a-96b839e45dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:02.773937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c673-200e-491e-b84a-96b839e45dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:02.774230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c673-200e-491e-b84a-96b839e45dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:02.774518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c673-200e-491e-b84a-96b839e45dd0 admin admin] PATH_INFO: `/v3/users/ad23da8435de4197b014b33efda92485` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:02.775627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2c673-200e-491e-b84a-96b839e45dd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=ad23da8435de4197b014b33efda92485)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:02.801989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2c673-200e-491e-b84a-96b839e45dd0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:02.803466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 87/173] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:55:02 2021] GET /identity/v3/users/ad23da8435de4197b014b33efda92485 => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:02.808629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148d20a-5b8b-4eaa-a250-59012193ff0c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:02.818603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148d20a-5b8b-4eaa-a250-59012193ff0c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:02.823089 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91ffb1-5d3a-4fb0-9332-0cfbf2eaa233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:02.823892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ffb1-5d3a-4fb0-9332-0cfbf2eaa233 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:02.824186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ffb1-5d3a-4fb0-9332-0cfbf2eaa233 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:02.824474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ffb1-5d3a-4fb0-9332-0cfbf2eaa233 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:02.825556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91ffb1-5d3a-4fb0-9332-0cfbf2eaa233 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:02.851676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91ffb1-5d3a-4fb0-9332-0cfbf2eaa233 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:02.853313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 87/174] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:02 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:02.858959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c673-200e-491e-b84a-96b839e45dd0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:02.869255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c673-200e-491e-b84a-96b839e45dd0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:02.873806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31398375-35bf-43dd-a80e-3557cd1b6f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:02.874641 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31398375-35bf-43dd-a80e-3557cd1b6f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:02.874946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31398375-35bf-43dd-a80e-3557cd1b6f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:02.875228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31398375-35bf-43dd-a80e-3557cd1b6f8c admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4/users/ad23da8435de4197b014b33efda92485/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:02.877317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31398375-35bf-43dd-a80e-3557cd1b6f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=833020c6e97d4c80bbe449fc92e597a4, user_id=ad23da8435de4197b014b33efda92485, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:02.903410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31398375-35bf-43dd-a80e-3557cd1b6f8c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:02.916556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 88/175] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:55:02 2021] PUT /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4/users/ad23da8435de4197b014b33efda92485/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:55:04.864018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd385e-e2b1-4531-af9e-58cac2e52e1b None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:04.864543 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd385e-e2b1-4531-af9e-58cac2e52e1b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:04.864648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd385e-e2b1-4531-af9e-58cac2e52e1b None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:04.866241 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 88/176] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:04.871409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170afe-81e7-4e18-8b66-31d750fbefc1 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:04.871818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170afe-81e7-4e18-8b66-31d750fbefc1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:04.871983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170afe-81e7-4e18-8b66-31d750fbefc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:04.894841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-78170afe-81e7-4e18-8b66-31d750fbefc1 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:04.895970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-78170afe-81e7-4e18-8b66-31d750fbefc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:04.958631 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 89/177] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:55:04.980560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd385e-e2b1-4531-af9e-58cac2e52e1b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:04.993357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd385e-e2b1-4531-af9e-58cac2e52e1b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:04.997152 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1c49-a7b6-4320-a2a4-fb707d8cd1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:04.997879 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1c49-a7b6-4320-a2a4-fb707d8cd1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:04.998171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1c49-a7b6-4320-a2a4-fb707d8cd1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:04.998456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1c49-a7b6-4320-a2a4-fb707d8cd1f8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:05.010595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd1c49-a7b6-4320-a2a4-fb707d8cd1f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:05.017026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-5cfd1c49-a7b6-4320-a2a4-fb707d8cd1f8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:55:05.018305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 89/178] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:05.024000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170afe-81e7-4e18-8b66-31d750fbefc1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:05.033045 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170afe-81e7-4e18-8b66-31d750fbefc1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:05.037039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b2ee-be9b-4673-aa3e-383dd0f1caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:05.037633 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b2ee-be9b-4673-aa3e-383dd0f1caf8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:05.037914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b2ee-be9b-4673-aa3e-383dd0f1caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:05.038193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b2ee-be9b-4673-aa3e-383dd0f1caf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:05.038927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b2ee-be9b-4673-aa3e-383dd0f1caf8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:05.039224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b2ee-be9b-4673-aa3e-383dd0f1caf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:05.065033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b2ee-be9b-4673-aa3e-383dd0f1caf8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:05.073427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 90/179] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:55:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:05.078954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1c49-a7b6-4320-a2a4-fb707d8cd1f8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:05.088188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1c49-a7b6-4320-a2a4-fb707d8cd1f8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:05.092015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6139825-f9af-4b42-873d-980f58110a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:05.092803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139825-f9af-4b42-873d-980f58110a3e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:05.093096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139825-f9af-4b42-873d-980f58110a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:05.093382 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139825-f9af-4b42-873d-980f58110a3e admin admin] PATH_INFO: `/v3/users/ad23da8435de4197b014b33efda92485` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:05.094454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6139825-f9af-4b42-873d-980f58110a3e admin admin] RBAC: Authorizing `identity:get_user(user_id=ad23da8435de4197b014b33efda92485)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:05.121397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6139825-f9af-4b42-873d-980f58110a3e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:05.122810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 90/180] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:55:05 2021] GET /identity/v3/users/ad23da8435de4197b014b33efda92485 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:05.128589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b2ee-be9b-4673-aa3e-383dd0f1caf8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:05.138027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b2ee-be9b-4673-aa3e-383dd0f1caf8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:05.141942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce733f1c-a284-442d-bf2b-4c535c97a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:05.142598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce733f1c-a284-442d-bf2b-4c535c97a7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:05.142923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce733f1c-a284-442d-bf2b-4c535c97a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:05.143203 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce733f1c-a284-442d-bf2b-4c535c97a7b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:05.150785 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce733f1c-a284-442d-bf2b-4c535c97a7b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:05.177056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce733f1c-a284-442d-bf2b-4c535c97a7b5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:05.185420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 91/181] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:05.191008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6139825-f9af-4b42-873d-980f58110a3e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:05.200201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6139825-f9af-4b42-873d-980f58110a3e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:05.204008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d07c3-3001-41f3-9b6a-17b099d79ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:05.204785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d07c3-3001-41f3-9b6a-17b099d79ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:05.205068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d07c3-3001-41f3-9b6a-17b099d79ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:05.205347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d07c3-3001-41f3-9b6a-17b099d79ba1 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:05.206395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d07c3-3001-41f3-9b6a-17b099d79ba1 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:05.232145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d07c3-3001-41f3-9b6a-17b099d79ba1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:05.233651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 91/182] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:05 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:05.239970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce733f1c-a284-442d-bf2b-4c535c97a7b5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:05.248681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce733f1c-a284-442d-bf2b-4c535c97a7b5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:05.252721 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bb002-846b-4339-82d0-3b0c46916521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:05.253301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bb002-846b-4339-82d0-3b0c46916521 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:05.253595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bb002-846b-4339-82d0-3b0c46916521 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:05.253885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bb002-846b-4339-82d0-3b0c46916521 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:05.254678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bb002-846b-4339-82d0-3b0c46916521 admin admin] RBAC: Adding query filter params (role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=833020c6e97d4c80bbe449fc92e597a4, user.id=ad23da8435de4197b014b33efda92485) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:05.254987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bb002-846b-4339-82d0-3b0c46916521 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:05.280299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bb002-846b-4339-82d0-3b0c46916521 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:05.287221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 92/183] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:55:05 2021] GET /identity/v3/role_assignments?user.id=ad23da8435de4197b014b33efda92485&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=871d3e9701f04be1906b8ef20b10077b => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:07.298799 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd311a-91de-4fb0-8185-6656e123094d None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:07.299286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd311a-91de-4fb0-8185-6656e123094d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:07.299286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd311a-91de-4fb0-8185-6656e123094d None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:07.300978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 92/184] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:07.306115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8caf14-2532-4c8e-b9cd-ed984d6ce6b1 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:07.306496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8caf14-2532-4c8e-b9cd-ed984d6ce6b1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:07.306726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8caf14-2532-4c8e-b9cd-ed984d6ce6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:07.329918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-de8caf14-2532-4c8e-b9cd-ed984d6ce6b1 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:07.331127 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-de8caf14-2532-4c8e-b9cd-ed984d6ce6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:07.337742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 93/185] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:07.359127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd311a-91de-4fb0-8185-6656e123094d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:07.375573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd311a-91de-4fb0-8185-6656e123094d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:07.379860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3718-570e-4765-987b-ddbeb3cae357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:07.380569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3718-570e-4765-987b-ddbeb3cae357 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:07.380853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3718-570e-4765-987b-ddbeb3cae357 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:07.381134 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3718-570e-4765-987b-ddbeb3cae357 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:07.392553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3718-570e-4765-987b-ddbeb3cae357 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:07.398662 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-b39e3718-570e-4765-987b-ddbeb3cae357 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:55:07.399736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 93/186] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:55:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:07.405275 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8caf14-2532-4c8e-b9cd-ed984d6ce6b1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:07.414080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8caf14-2532-4c8e-b9cd-ed984d6ce6b1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:07.418376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcfc20-3fb1-465a-a8f5-4bac40f7246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:07.419018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcfc20-3fb1-465a-a8f5-4bac40f7246d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:07.419314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcfc20-3fb1-465a-a8f5-4bac40f7246d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:07.419602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcfc20-3fb1-465a-a8f5-4bac40f7246d admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:07.420321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcfc20-3fb1-465a-a8f5-4bac40f7246d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:07.420626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcfc20-3fb1-465a-a8f5-4bac40f7246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:07.446380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcfc20-3fb1-465a-a8f5-4bac40f7246d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:07.456389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 94/187] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:07.463902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3718-570e-4765-987b-ddbeb3cae357 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:07.474814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3718-570e-4765-987b-ddbeb3cae357 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:07.478715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45c0be-3734-4797-b9d3-18584001274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:07.479503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c0be-3734-4797-b9d3-18584001274a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:07.479792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c0be-3734-4797-b9d3-18584001274a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:07.480074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c0be-3734-4797-b9d3-18584001274a admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:07.481144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45c0be-3734-4797-b9d3-18584001274a admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:07.507687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45c0be-3734-4797-b9d3-18584001274a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:07.509144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 94/188] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:55:07 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:07.514595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcfc20-3fb1-465a-a8f5-4bac40f7246d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:07.524590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcfc20-3fb1-465a-a8f5-4bac40f7246d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:07.528481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21a1d3-144e-427e-91a6-40f1448cc23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:07.529052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21a1d3-144e-427e-91a6-40f1448cc23b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:07.529346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21a1d3-144e-427e-91a6-40f1448cc23b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:07.529633 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21a1d3-144e-427e-91a6-40f1448cc23b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:07.537508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21a1d3-144e-427e-91a6-40f1448cc23b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:07.562923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21a1d3-144e-427e-91a6-40f1448cc23b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:07.571851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 95/189] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:07.577235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45c0be-3734-4797-b9d3-18584001274a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:07.587644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45c0be-3734-4797-b9d3-18584001274a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:07.591548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5819d-ae38-4cf8-82d9-b0e4829fc661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:07.592325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5819d-ae38-4cf8-82d9-b0e4829fc661 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:07.592618 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5819d-ae38-4cf8-82d9-b0e4829fc661 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:07.592905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5819d-ae38-4cf8-82d9-b0e4829fc661 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:07.593972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5819d-ae38-4cf8-82d9-b0e4829fc661 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:07.620354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5819d-ae38-4cf8-82d9-b0e4829fc661 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:07.621863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 95/190] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:07 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:07.628255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21a1d3-144e-427e-91a6-40f1448cc23b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:07.636788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21a1d3-144e-427e-91a6-40f1448cc23b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:07.640651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2b8d6-5961-4230-aa2a-5550560d5d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:07.641222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b8d6-5961-4230-aa2a-5550560d5d9d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:07.641514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b8d6-5961-4230-aa2a-5550560d5d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:07.641933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b8d6-5961-4230-aa2a-5550560d5d9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:07.642967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2b8d6-5961-4230-aa2a-5550560d5d9d admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=833020c6e97d4c80bbe449fc92e597a4, user.id=35ed18ce25b9435aaf42d0a0ed7b1a41) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:07.643281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2b8d6-5961-4230-aa2a-5550560d5d9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:07.668800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2b8d6-5961-4230-aa2a-5550560d5d9d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:07.675070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 96/191] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:55:07 2021] GET /identity/v3/role_assignments?user.id=35ed18ce25b9435aaf42d0a0ed7b1a41&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:09.593528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef64b-e0ab-4be8-981c-35409503cac6 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:09.594036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef64b-e0ab-4be8-981c-35409503cac6 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:09.594120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef64b-e0ab-4be8-981c-35409503cac6 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:09.596395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 96/192] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:09.601452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fc914-6602-4f37-a020-e050f4dde976 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:09.601858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fc914-6602-4f37-a020-e050f4dde976 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:09.602016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fc914-6602-4f37-a020-e050f4dde976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:09.624877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-440fc914-6602-4f37-a020-e050f4dde976 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:09.626016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-440fc914-6602-4f37-a020-e050f4dde976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:09.632691 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 97/193] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:09.653627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aef64b-e0ab-4be8-981c-35409503cac6 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:09.665639 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aef64b-e0ab-4be8-981c-35409503cac6 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:09.669448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b463-e424-4807-959a-c152bf733f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:09.670120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b463-e424-4807-959a-c152bf733f49 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:09.670408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b463-e424-4807-959a-c152bf733f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:09.670713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393b463-e424-4807-959a-c152bf733f49 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:09.682143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393b463-e424-4807-959a-c152bf733f49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:09.688306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-b393b463-e424-4807-959a-c152bf733f49 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:55:09.689558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 97/194] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:55:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:09.696816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fc914-6602-4f37-a020-e050f4dde976 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:09.708006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fc914-6602-4f37-a020-e050f4dde976 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:09.711970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba583-25b4-43a4-a36a-4ac2958592d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:09.712554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba583-25b4-43a4-a36a-4ac2958592d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:09.712842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba583-25b4-43a4-a36a-4ac2958592d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:09.713125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba583-25b4-43a4-a36a-4ac2958592d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:09.713827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ba583-25b4-43a4-a36a-4ac2958592d3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:09.714124 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ba583-25b4-43a4-a36a-4ac2958592d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:09.740530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ba583-25b4-43a4-a36a-4ac2958592d3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:09.749052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 98/195] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:09.754640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b463-e424-4807-959a-c152bf733f49 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:09.764793 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393b463-e424-4807-959a-c152bf733f49 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:09.768879 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751b890-78f6-4370-be35-2c0bd131563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:09.769667 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751b890-78f6-4370-be35-2c0bd131563d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:09.769954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751b890-78f6-4370-be35-2c0bd131563d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:09.770237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751b890-78f6-4370-be35-2c0bd131563d admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:09.771336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751b890-78f6-4370-be35-2c0bd131563d admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:09.796873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751b890-78f6-4370-be35-2c0bd131563d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:09.799309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 98/196] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:55:09 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:09.804528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba583-25b4-43a4-a36a-4ac2958592d3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:09.813871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba583-25b4-43a4-a36a-4ac2958592d3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:09.817784 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91184ead-5d8a-47b8-8945-dd05868902a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:09.818569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91184ead-5d8a-47b8-8945-dd05868902a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:09.818891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91184ead-5d8a-47b8-8945-dd05868902a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:09.819173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91184ead-5d8a-47b8-8945-dd05868902a5 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:09.820237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91184ead-5d8a-47b8-8945-dd05868902a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:09.846444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91184ead-5d8a-47b8-8945-dd05868902a5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:09.848022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 99/197] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:09 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:09.853587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751b890-78f6-4370-be35-2c0bd131563d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:09.864044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751b890-78f6-4370-be35-2c0bd131563d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:09.867911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070b759-149b-414e-a1d4-55833efb2130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:09.868724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b759-149b-414e-a1d4-55833efb2130 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:09.869015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b759-149b-414e-a1d4-55833efb2130 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:09.869301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b759-149b-414e-a1d4-55833efb2130 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4/users/35ed18ce25b9435aaf42d0a0ed7b1a41/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:09.871063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070b759-149b-414e-a1d4-55833efb2130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833020c6e97d4c80bbe449fc92e597a4, user_id=35ed18ce25b9435aaf42d0a0ed7b1a41, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:09.897750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070b759-149b-414e-a1d4-55833efb2130 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:09.910452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 99/198] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:55:09 2021] PUT /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4/users/35ed18ce25b9435aaf42d0a0ed7b1a41/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 13:55:11.855531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade30c9f-5a75-437b-b507-5e6463b7c66d None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:11.856052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade30c9f-5a75-437b-b507-5e6463b7c66d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:11.856139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade30c9f-5a75-437b-b507-5e6463b7c66d None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:11.857760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 100/199] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:11.863383 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881482-046b-49f9-af16-75ffc5779fe6 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:11.863776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881482-046b-49f9-af16-75ffc5779fe6 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:11.863961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881482-046b-49f9-af16-75ffc5779fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:11.886571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-9c881482-046b-49f9-af16-75ffc5779fe6 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:11.887733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9c881482-046b-49f9-af16-75ffc5779fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:11.953863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 100/200] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:55:11.977085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade30c9f-5a75-437b-b507-5e6463b7c66d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:11.988855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade30c9f-5a75-437b-b507-5e6463b7c66d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:11.992686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778217a-be48-4087-9bca-7561f1d9ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:11.993468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778217a-be48-4087-9bca-7561f1d9ca0a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:11.993821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778217a-be48-4087-9bca-7561f1d9ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:11.994167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778217a-be48-4087-9bca-7561f1d9ca0a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:12.006563 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778217a-be48-4087-9bca-7561f1d9ca0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:12.012770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-5778217a-be48-4087-9bca-7561f1d9ca0a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:55:12.013863 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 101/201] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:55:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:12.020181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c881482-046b-49f9-af16-75ffc5779fe6 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:12.028781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c881482-046b-49f9-af16-75ffc5779fe6 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:12.032810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35dda2-9c66-4b5f-bea5-8a138eea02f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:12.033398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35dda2-9c66-4b5f-bea5-8a138eea02f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:12.033692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35dda2-9c66-4b5f-bea5-8a138eea02f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:12.033978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35dda2-9c66-4b5f-bea5-8a138eea02f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:12.034725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35dda2-9c66-4b5f-bea5-8a138eea02f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:12.035028 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35dda2-9c66-4b5f-bea5-8a138eea02f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:12.060090 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35dda2-9c66-4b5f-bea5-8a138eea02f8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:12.069229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 101/202] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:12.074810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778217a-be48-4087-9bca-7561f1d9ca0a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:12.084526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778217a-be48-4087-9bca-7561f1d9ca0a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:12.088300 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b100e3-abde-4708-9454-63c34931e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:12.089080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b100e3-abde-4708-9454-63c34931e29e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:12.089367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b100e3-abde-4708-9454-63c34931e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:12.089646 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b100e3-abde-4708-9454-63c34931e29e admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:12.090736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b100e3-abde-4708-9454-63c34931e29e admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:12.116643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b100e3-abde-4708-9454-63c34931e29e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:12.118028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 102/203] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:55:12 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:12.123285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35dda2-9c66-4b5f-bea5-8a138eea02f8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:12.133110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35dda2-9c66-4b5f-bea5-8a138eea02f8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:12.136981 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9eaf2-b30d-4e2a-a757-3cd5410a61ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:12.137546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9eaf2-b30d-4e2a-a757-3cd5410a61ff admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:12.137841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9eaf2-b30d-4e2a-a757-3cd5410a61ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:12.138135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9eaf2-b30d-4e2a-a757-3cd5410a61ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:12.146052 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9eaf2-b30d-4e2a-a757-3cd5410a61ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:12.171075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9eaf2-b30d-4e2a-a757-3cd5410a61ff admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:12.180162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 102/204] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:12.185547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b100e3-abde-4708-9454-63c34931e29e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:12.195429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b100e3-abde-4708-9454-63c34931e29e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:12.199210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b45419-085f-484b-aa23-9de728d333bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:12.199974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b45419-085f-484b-aa23-9de728d333bb admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:12.200261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b45419-085f-484b-aa23-9de728d333bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:12.200540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b45419-085f-484b-aa23-9de728d333bb admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:12.201583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b45419-085f-484b-aa23-9de728d333bb admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:12.226951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b45419-085f-484b-aa23-9de728d333bb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:12.228436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 103/205] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:12 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:12.233843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9eaf2-b30d-4e2a-a757-3cd5410a61ff admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:12.243537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9eaf2-b30d-4e2a-a757-3cd5410a61ff admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:12.247406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a54868-5c44-43b1-bea4-ed7f9f726e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:12.247983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a54868-5c44-43b1-bea4-ed7f9f726e9a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:12.248271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a54868-5c44-43b1-bea4-ed7f9f726e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:12.248548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a54868-5c44-43b1-bea4-ed7f9f726e9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:12.249312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a54868-5c44-43b1-bea4-ed7f9f726e9a admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=833020c6e97d4c80bbe449fc92e597a4, user.id=35ed18ce25b9435aaf42d0a0ed7b1a41) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:12.249613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a54868-5c44-43b1-bea4-ed7f9f726e9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:12.275220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a54868-5c44-43b1-bea4-ed7f9f726e9a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:12.281079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 103/206] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:55:12 2021] GET /identity/v3/role_assignments?user.id=35ed18ce25b9435aaf42d0a0ed7b1a41&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:14.283449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cf1c9-dea2-4265-8030-0d9e95b3218b None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:14.283959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cf1c9-dea2-4265-8030-0d9e95b3218b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:14.283959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cf1c9-dea2-4265-8030-0d9e95b3218b None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:14.285600 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 104/207] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:14.290778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180739d-857f-4be4-9bad-519b63966a42 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:14.291296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180739d-857f-4be4-9bad-519b63966a42 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:14.291517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180739d-857f-4be4-9bad-519b63966a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:14.314121 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c180739d-857f-4be4-9bad-519b63966a42 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:14.315284 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c180739d-857f-4be4-9bad-519b63966a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:14.321811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 104/208] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:55:14.343750 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cf1c9-dea2-4265-8030-0d9e95b3218b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:14.355875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cf1c9-dea2-4265-8030-0d9e95b3218b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:14.359690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce320e-9e20-4d0a-9b3d-2f0a06e78e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:14.361308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce320e-9e20-4d0a-9b3d-2f0a06e78e02 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:14.361605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce320e-9e20-4d0a-9b3d-2f0a06e78e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:14.361887 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce320e-9e20-4d0a-9b3d-2f0a06e78e02 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:14.373051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce320e-9e20-4d0a-9b3d-2f0a06e78e02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:14.379759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-21ce320e-9e20-4d0a-9b3d-2f0a06e78e02 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:55:14.380844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 105/209] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:55:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:14.386393 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180739d-857f-4be4-9bad-519b63966a42 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:14.395431 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180739d-857f-4be4-9bad-519b63966a42 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:14.399342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ea96a-cf4f-4a3e-b10e-54983cf4ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:14.399928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ea96a-cf4f-4a3e-b10e-54983cf4ae32 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:14.400214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ea96a-cf4f-4a3e-b10e-54983cf4ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:14.400496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ea96a-cf4f-4a3e-b10e-54983cf4ae32 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:14.401195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ea96a-cf4f-4a3e-b10e-54983cf4ae32 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:14.401492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ea96a-cf4f-4a3e-b10e-54983cf4ae32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:14.426840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ea96a-cf4f-4a3e-b10e-54983cf4ae32 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:14.435144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 105/210] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:55:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:14.441095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce320e-9e20-4d0a-9b3d-2f0a06e78e02 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:14.452796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce320e-9e20-4d0a-9b3d-2f0a06e78e02 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:14.456684 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30adc-890b-4932-a76b-136704375569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:14.457462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30adc-890b-4932-a76b-136704375569 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:14.457751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30adc-890b-4932-a76b-136704375569 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:14.458034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30adc-890b-4932-a76b-136704375569 admin admin] PATH_INFO: `/v3/users/ad23da8435de4197b014b33efda92485` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:14.459125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c30adc-890b-4932-a76b-136704375569 admin admin] RBAC: Authorizing `identity:get_user(user_id=ad23da8435de4197b014b33efda92485)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:14.484443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c30adc-890b-4932-a76b-136704375569 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:14.486833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 106/211] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:55:14 2021] GET /identity/v3/users/ad23da8435de4197b014b33efda92485 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:55:14.491983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ea96a-cf4f-4a3e-b10e-54983cf4ae32 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:14.501754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ea96a-cf4f-4a3e-b10e-54983cf4ae32 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:14.505616 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b61fcd-976a-4dc6-a588-90743d5e4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:14.506195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b61fcd-976a-4dc6-a588-90743d5e4078 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:14.506488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b61fcd-976a-4dc6-a588-90743d5e4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:14.506814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b61fcd-976a-4dc6-a588-90743d5e4078 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:14.514327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b61fcd-976a-4dc6-a588-90743d5e4078 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:14.539611 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b61fcd-976a-4dc6-a588-90743d5e4078 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:14.548440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 106/212] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:14.553731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30adc-890b-4932-a76b-136704375569 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:14.563031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30adc-890b-4932-a76b-136704375569 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:14.567436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e0eb8-3728-4acc-9888-9cc15093018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:14.568200 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e0eb8-3728-4acc-9888-9cc15093018f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:14.568484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e0eb8-3728-4acc-9888-9cc15093018f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:14.568759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e0eb8-3728-4acc-9888-9cc15093018f admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:14.569800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e0eb8-3728-4acc-9888-9cc15093018f admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:14.595051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e0eb8-3728-4acc-9888-9cc15093018f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:14.596531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 107/213] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:14 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:14.601887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b61fcd-976a-4dc6-a588-90743d5e4078 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:14.611241 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b61fcd-976a-4dc6-a588-90743d5e4078 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:14.615128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96cd7-a6d3-4806-87ab-78ae803d0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:14.615706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96cd7-a6d3-4806-87ab-78ae803d0805 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:14.615994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96cd7-a6d3-4806-87ab-78ae803d0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:14.616282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96cd7-a6d3-4806-87ab-78ae803d0805 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:14.617055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96cd7-a6d3-4806-87ab-78ae803d0805 admin admin] RBAC: Adding query filter params (role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=833020c6e97d4c80bbe449fc92e597a4, user.id=ad23da8435de4197b014b33efda92485) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:14.617364 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96cd7-a6d3-4806-87ab-78ae803d0805 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:14.643459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96cd7-a6d3-4806-87ab-78ae803d0805 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:14.649007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 107/214] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:55:14 2021] GET /identity/v3/role_assignments?user.id=ad23da8435de4197b014b33efda92485&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:16.664737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c5e8f-8dc4-4fef-9822-862344aa9d97 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:16.665261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c5e8f-8dc4-4fef-9822-862344aa9d97 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:16.665366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c5e8f-8dc4-4fef-9822-862344aa9d97 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:16.667006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 108/215] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:16.672087 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e496b-9dc2-46f8-9588-0303d52f842b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:16.672476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e496b-9dc2-46f8-9588-0303d52f842b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:16.673191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e496b-9dc2-46f8-9588-0303d52f842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:16.695807 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-339e496b-9dc2-46f8-9588-0303d52f842b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:16.696917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-339e496b-9dc2-46f8-9588-0303d52f842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:16.703468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 108/216] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:16.724599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c5e8f-8dc4-4fef-9822-862344aa9d97 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:16.737057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c5e8f-8dc4-4fef-9822-862344aa9d97 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:16.740993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd3421-d5e4-4258-a826-2fee810226c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:16.741717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd3421-d5e4-4258-a826-2fee810226c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:16.742009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd3421-d5e4-4258-a826-2fee810226c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:16.742298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd3421-d5e4-4258-a826-2fee810226c6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:16.754347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd3421-d5e4-4258-a826-2fee810226c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:16.761024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-82fd3421-d5e4-4258-a826-2fee810226c6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:55:16.762102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 109/217] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:55:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:16.768038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e496b-9dc2-46f8-9588-0303d52f842b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:16.776593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e496b-9dc2-46f8-9588-0303d52f842b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:16.780546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252de0e4-2c8d-4b45-975a-32170671a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:16.781133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252de0e4-2c8d-4b45-975a-32170671a9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:16.781426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252de0e4-2c8d-4b45-975a-32170671a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:16.781708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252de0e4-2c8d-4b45-975a-32170671a9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:16.782505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252de0e4-2c8d-4b45-975a-32170671a9d4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:16.782828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252de0e4-2c8d-4b45-975a-32170671a9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:16.808321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252de0e4-2c8d-4b45-975a-32170671a9d4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:16.817437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 109/218] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:55:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:55:16.823036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd3421-d5e4-4258-a826-2fee810226c6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:16.833329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd3421-d5e4-4258-a826-2fee810226c6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:16.837184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f0833-66bc-4c4a-992d-2c94b323fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:16.837976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f0833-66bc-4c4a-992d-2c94b323fdef admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:16.838260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f0833-66bc-4c4a-992d-2c94b323fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:16.838539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f0833-66bc-4c4a-992d-2c94b323fdef admin admin] PATH_INFO: `/v3/users/ad23da8435de4197b014b33efda92485` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:16.839631 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f0833-66bc-4c4a-992d-2c94b323fdef admin admin] RBAC: Authorizing `identity:get_user(user_id=ad23da8435de4197b014b33efda92485)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:16.865927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f0833-66bc-4c4a-992d-2c94b323fdef admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:16.867452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 110/219] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:55:16 2021] GET /identity/v3/users/ad23da8435de4197b014b33efda92485 => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:16.872911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252de0e4-2c8d-4b45-975a-32170671a9d4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:16.883328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252de0e4-2c8d-4b45-975a-32170671a9d4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:16.887315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d496a0-a970-4eee-9607-31674ec0ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:16.888098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d496a0-a970-4eee-9607-31674ec0ab2c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:16.888390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d496a0-a970-4eee-9607-31674ec0ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:16.888679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d496a0-a970-4eee-9607-31674ec0ab2c admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:16.889747 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d496a0-a970-4eee-9607-31674ec0ab2c admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:16.915232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d496a0-a970-4eee-9607-31674ec0ab2c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:16.916699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 110/220] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:16 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:16.922160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f0833-66bc-4c4a-992d-2c94b323fdef admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:16.932099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f0833-66bc-4c4a-992d-2c94b323fdef admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:16.935944 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be969def-3358-42e8-935c-0173b4e83a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:16.936750 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969def-3358-42e8-935c-0173b4e83a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:16.937039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969def-3358-42e8-935c-0173b4e83a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:16.937322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be969def-3358-42e8-935c-0173b4e83a48 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4/users/ad23da8435de4197b014b33efda92485/roles/886f966104ce425fa75dbe7ee88aba33` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:16.939861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be969def-3358-42e8-935c-0173b4e83a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833020c6e97d4c80bbe449fc92e597a4, user_id=ad23da8435de4197b014b33efda92485, role_id=886f966104ce425fa75dbe7ee88aba33)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:16.965704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be969def-3358-42e8-935c-0173b4e83a48 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:16.978790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 111/221] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:55:16 2021] PUT /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4/users/ad23da8435de4197b014b33efda92485/roles/886f966104ce425fa75dbe7ee88aba33 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:55:18.941460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879342-740a-44b7-bc69-73a5570f1a4e None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:18.942023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879342-740a-44b7-bc69-73a5570f1a4e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:18.942023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879342-740a-44b7-bc69-73a5570f1a4e None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:18.943723 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 111/222] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:18.948884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d19c28-739c-4240-b6a3-a0dc7a20988f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:18.949253 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d19c28-739c-4240-b6a3-a0dc7a20988f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:18.949465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d19c28-739c-4240-b6a3-a0dc7a20988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:18.971841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-27d19c28-739c-4240-b6a3-a0dc7a20988f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:18.972976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-27d19c28-739c-4240-b6a3-a0dc7a20988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:19.037160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 112/223] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:55:19.059624 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879342-740a-44b7-bc69-73a5570f1a4e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:19.071824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879342-740a-44b7-bc69-73a5570f1a4e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:19.075676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c88d-9b57-43be-9086-35c2bacc72a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:19.076407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c88d-9b57-43be-9086-35c2bacc72a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:19.076727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c88d-9b57-43be-9086-35c2bacc72a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:19.077015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c88d-9b57-43be-9086-35c2bacc72a5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:19.089078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658c88d-9b57-43be-9086-35c2bacc72a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:19.096115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-6658c88d-9b57-43be-9086-35c2bacc72a5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:55:19.097208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 112/224] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:55:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:55:19.102907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d19c28-739c-4240-b6a3-a0dc7a20988f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:19.112451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d19c28-739c-4240-b6a3-a0dc7a20988f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:19.116452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11ecfb-cc30-44d9-a1f7-8ffb7e1a67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:19.117047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11ecfb-cc30-44d9-a1f7-8ffb7e1a67bf admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:19.117341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11ecfb-cc30-44d9-a1f7-8ffb7e1a67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:19.117630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11ecfb-cc30-44d9-a1f7-8ffb7e1a67bf admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:19.118341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11ecfb-cc30-44d9-a1f7-8ffb7e1a67bf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:19.118671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11ecfb-cc30-44d9-a1f7-8ffb7e1a67bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:19.144298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11ecfb-cc30-44d9-a1f7-8ffb7e1a67bf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:19.152849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 113/225] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:55:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:19.158550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c88d-9b57-43be-9086-35c2bacc72a5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:19.167687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c88d-9b57-43be-9086-35c2bacc72a5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:19.171469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0529a-b086-4703-905b-8c22c0a269c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:19.172250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0529a-b086-4703-905b-8c22c0a269c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:19.173041 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0529a-b086-4703-905b-8c22c0a269c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:19.173375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0529a-b086-4703-905b-8c22c0a269c1 admin admin] PATH_INFO: `/v3/users/ad23da8435de4197b014b33efda92485` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:19.174461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0529a-b086-4703-905b-8c22c0a269c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=ad23da8435de4197b014b33efda92485)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:19.200412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0529a-b086-4703-905b-8c22c0a269c1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:19.201824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 113/226] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:55:19 2021] GET /identity/v3/users/ad23da8435de4197b014b33efda92485 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:19.207275 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11ecfb-cc30-44d9-a1f7-8ffb7e1a67bf admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:19.216654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11ecfb-cc30-44d9-a1f7-8ffb7e1a67bf admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:19.221360 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf6d0-6302-4d1f-830a-0c5eb0fb90d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:19.221934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf6d0-6302-4d1f-830a-0c5eb0fb90d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:19.222227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf6d0-6302-4d1f-830a-0c5eb0fb90d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:19.222511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf6d0-6302-4d1f-830a-0c5eb0fb90d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:19.230218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf6d0-6302-4d1f-830a-0c5eb0fb90d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:19.256747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf6d0-6302-4d1f-830a-0c5eb0fb90d1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:19.265825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 114/227] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:19.271498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0529a-b086-4703-905b-8c22c0a269c1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:19.280753 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0529a-b086-4703-905b-8c22c0a269c1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:19.285560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ef332-ad24-47aa-af1b-d69068aa23d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:19.286340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef332-ad24-47aa-af1b-d69068aa23d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:19.286646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef332-ad24-47aa-af1b-d69068aa23d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:19.286941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef332-ad24-47aa-af1b-d69068aa23d0 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:19.288027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ef332-ad24-47aa-af1b-d69068aa23d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:19.313867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ef332-ad24-47aa-af1b-d69068aa23d0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:19.315435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 114/228] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:19 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:19.321161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf6d0-6302-4d1f-830a-0c5eb0fb90d1 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:19.329886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf6d0-6302-4d1f-830a-0c5eb0fb90d1 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:19.333748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82a7a0-9afe-4e7b-9381-54018c376a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:19.334321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a7a0-9afe-4e7b-9381-54018c376a65 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:19.334605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a7a0-9afe-4e7b-9381-54018c376a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:19.334918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82a7a0-9afe-4e7b-9381-54018c376a65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:19.335683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82a7a0-9afe-4e7b-9381-54018c376a65 admin admin] RBAC: Adding query filter params (role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=833020c6e97d4c80bbe449fc92e597a4, user.id=ad23da8435de4197b014b33efda92485) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:19.335987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82a7a0-9afe-4e7b-9381-54018c376a65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:19.362404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82a7a0-9afe-4e7b-9381-54018c376a65 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:19.368547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 115/229] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:55:19 2021] GET /identity/v3/role_assignments?user.id=ad23da8435de4197b014b33efda92485&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:21.367736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327e34-cdc6-43cf-a700-98577a2be801 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:21.368747 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327e34-cdc6-43cf-a700-98577a2be801 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:21.369241 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327e34-cdc6-43cf-a700-98577a2be801 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:21.371234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 115/230] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:21.376736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd6bb-9dea-4645-b41a-20679820629b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:21.377225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd6bb-9dea-4645-b41a-20679820629b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:21.377442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd6bb-9dea-4645-b41a-20679820629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:21.400617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-960bd6bb-9dea-4645-b41a-20679820629b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:21.401750 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-960bd6bb-9dea-4645-b41a-20679820629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:21.410768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 116/231] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:21.431554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327e34-cdc6-43cf-a700-98577a2be801 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:21.443531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327e34-cdc6-43cf-a700-98577a2be801 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:21.447360 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a1cfc-7404-4bf8-8e6f-980da2cf5257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:21.448079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a1cfc-7404-4bf8-8e6f-980da2cf5257 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:21.448371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a1cfc-7404-4bf8-8e6f-980da2cf5257 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:21.448658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a1cfc-7404-4bf8-8e6f-980da2cf5257 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:21.449718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a1cfc-7404-4bf8-8e6f-980da2cf5257 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:21.476233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a1cfc-7404-4bf8-8e6f-980da2cf5257 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:21.477802 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 116/232] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:55:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:21.483495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd6bb-9dea-4645-b41a-20679820629b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:21.492748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd6bb-9dea-4645-b41a-20679820629b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:21.496695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34437d6-9a96-44fa-beb4-2b5af0941e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:21.497290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34437d6-9a96-44fa-beb4-2b5af0941e86 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:21.497585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34437d6-9a96-44fa-beb4-2b5af0941e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:21.498201 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34437d6-9a96-44fa-beb4-2b5af0941e86 admin admin] PATH_INFO: `/v3/groups` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:21.498516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34437d6-9a96-44fa-beb4-2b5af0941e86 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:21.524940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-f34437d6-9a96-44fa-beb4-2b5af0941e86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:55:21.524940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:55:21.524940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:55:21.526208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34437d6-9a96-44fa-beb4-2b5af0941e86 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:21.540281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 117/233] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Oct 27 13:55:21 2021] POST /identity/v3/groups => generated 229 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:55:23.508086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958ed45-9851-4a6a-a9cd-cc736059ec48 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:23.508635 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958ed45-9851-4a6a-a9cd-cc736059ec48 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:23.508635 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958ed45-9851-4a6a-a9cd-cc736059ec48 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:23.510350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 117/234] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:23.515356 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148ce07-0d2d-4f7e-b62f-e849775d1df3 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:23.515781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148ce07-0d2d-4f7e-b62f-e849775d1df3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:23.515937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148ce07-0d2d-4f7e-b62f-e849775d1df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:23.539797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-8148ce07-0d2d-4f7e-b62f-e849775d1df3 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:23.540914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8148ce07-0d2d-4f7e-b62f-e849775d1df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:23.547380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 118/235] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:55:23.568839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958ed45-9851-4a6a-a9cd-cc736059ec48 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:23.581010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958ed45-9851-4a6a-a9cd-cc736059ec48 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:23.584791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d32c-a324-47b3-ab45-0765d58d60a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:23.585496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d32c-a324-47b3-ab45-0765d58d60a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:23.585782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d32c-a324-47b3-ab45-0765d58d60a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:23.586062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d32c-a324-47b3-ab45-0765d58d60a7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:23.587117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415d32c-a324-47b3-ab45-0765d58d60a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:23.612962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415d32c-a324-47b3-ab45-0765d58d60a7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:23.614392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 118/236] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:55:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:23.619655 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148ce07-0d2d-4f7e-b62f-e849775d1df3 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:23.628701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148ce07-0d2d-4f7e-b62f-e849775d1df3 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:23.632560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be8762-7f7a-400b-8aa0-0da982031f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:23.633150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8762-7f7a-400b-8aa0-0da982031f16 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:23.633440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8762-7f7a-400b-8aa0-0da982031f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:23.633723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be8762-7f7a-400b-8aa0-0da982031f16 admin admin] PATH_INFO: `/v3/groups` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:23.634358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be8762-7f7a-400b-8aa0-0da982031f16 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:23.663602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be8762-7f7a-400b-8aa0-0da982031f16 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:23.676415 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 119/237] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Oct 27 13:55:23 2021] POST /identity/v3/groups => generated 226 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:55:25.626938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33383e2e-2374-47b6-a30c-a4ba696e2d87 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:25.627473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33383e2e-2374-47b6-a30c-a4ba696e2d87 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:25.627559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33383e2e-2374-47b6-a30c-a4ba696e2d87 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:25.629172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 119/238] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:25.634132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f600ef-f1e1-468c-9388-417269b1a86c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:25.634549 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f600ef-f1e1-468c-9388-417269b1a86c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:25.634728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f600ef-f1e1-468c-9388-417269b1a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:25.657715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-98f600ef-f1e1-468c-9388-417269b1a86c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:25.658870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-98f600ef-f1e1-468c-9388-417269b1a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:25.665397 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 120/239] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:25.687309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33383e2e-2374-47b6-a30c-a4ba696e2d87 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:25.698790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33383e2e-2374-47b6-a30c-a4ba696e2d87 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:25.702518 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7266671-adf0-4a9a-9cb6-90af5434468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:25.703263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7266671-adf0-4a9a-9cb6-90af5434468b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:25.703559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7266671-adf0-4a9a-9cb6-90af5434468b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:25.704407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7266671-adf0-4a9a-9cb6-90af5434468b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:25.716203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7266671-adf0-4a9a-9cb6-90af5434468b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:25.723613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e7266671-adf0-4a9a-9cb6-90af5434468b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:55:25.724692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 120/240] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:25.730305 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f600ef-f1e1-468c-9388-417269b1a86c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:25.739230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f600ef-f1e1-468c-9388-417269b1a86c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:25.743066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc00cc-1497-4353-a0ab-17108e026d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:25.743643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc00cc-1497-4353-a0ab-17108e026d01 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:25.743930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc00cc-1497-4353-a0ab-17108e026d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:25.744208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc00cc-1497-4353-a0ab-17108e026d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:25.744907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc00cc-1497-4353-a0ab-17108e026d01 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:25.745198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc00cc-1497-4353-a0ab-17108e026d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:25.770891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc00cc-1497-4353-a0ab-17108e026d01 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:25.780485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 121/241] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:55:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:25.790206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7266671-adf0-4a9a-9cb6-90af5434468b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:25.800674 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7266671-adf0-4a9a-9cb6-90af5434468b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:25.804851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1496df3-4b18-4890-8e5e-d48205cb34f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:25.805437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1496df3-4b18-4890-8e5e-d48205cb34f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:25.805730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1496df3-4b18-4890-8e5e-d48205cb34f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:25.806017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1496df3-4b18-4890-8e5e-d48205cb34f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:25.814192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1496df3-4b18-4890-8e5e-d48205cb34f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:25.839779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1496df3-4b18-4890-8e5e-d48205cb34f5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:25.849521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 121/242] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:55:25.855395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc00cc-1497-4353-a0ab-17108e026d01 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:25.865092 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc00cc-1497-4353-a0ab-17108e026d01 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:25.868956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7fe74-727d-4410-a68a-9a3b16241f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:25.869734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7fe74-727d-4410-a68a-9a3b16241f0c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:25.870027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7fe74-727d-4410-a68a-9a3b16241f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:25.870315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7fe74-727d-4410-a68a-9a3b16241f0c admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:25.871588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7fe74-727d-4410-a68a-9a3b16241f0c admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:25.897836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7fe74-727d-4410-a68a-9a3b16241f0c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:25.899356 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 122/243] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:25 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:25.905034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1496df3-4b18-4890-8e5e-d48205cb34f5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:25.914999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1496df3-4b18-4890-8e5e-d48205cb34f5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:25.918903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b8031-184f-449e-8a56-0574df4236ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:25.919679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8031-184f-449e-8a56-0574df4236ce admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:25.919969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8031-184f-449e-8a56-0574df4236ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:25.920254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8031-184f-449e-8a56-0574df4236ce admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:25.925519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b8031-184f-449e-8a56-0574df4236ce admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:25.950080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-5f2b8031-184f-449e-8a56-0574df4236ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:55:25.950080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:55:25.950080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:55:25.951281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b8031-184f-449e-8a56-0574df4236ce admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:25.952748 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 122/244] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:25 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:25.959102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7fe74-727d-4410-a68a-9a3b16241f0c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:25.968419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7fe74-727d-4410-a68a-9a3b16241f0c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:25.972359 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05947ab5-6cad-4200-926d-a0b51aaed156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:25.972934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05947ab5-6cad-4200-926d-a0b51aaed156 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:25.973230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05947ab5-6cad-4200-926d-a0b51aaed156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:25.973518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05947ab5-6cad-4200-926d-a0b51aaed156 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:25.974290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05947ab5-6cad-4200-926d-a0b51aaed156 admin admin] RBAC: Adding query filter params (group.id=3956e0a259c24bcdbd9f3221696817bb, role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:25.974602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05947ab5-6cad-4200-926d-a0b51aaed156 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:26.000988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05947ab5-6cad-4200-926d-a0b51aaed156 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:26.006601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 123/245] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:25 2021] GET /identity/v3/role_assignments?group.id=3956e0a259c24bcdbd9f3221696817bb&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=871d3e9701f04be1906b8ef20b10077b => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:27.979768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08212891-16ce-484e-822b-0f334a4386de None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:27.980286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08212891-16ce-484e-822b-0f334a4386de None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:27.980392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08212891-16ce-484e-822b-0f334a4386de None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:27.982016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 123/246] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:27.988141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b39ae-b348-4295-a271-e1545c62fe2b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:27.988560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b39ae-b348-4295-a271-e1545c62fe2b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:27.988799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b39ae-b348-4295-a271-e1545c62fe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:28.011777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-380b39ae-b348-4295-a271-e1545c62fe2b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:28.012912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-380b39ae-b348-4295-a271-e1545c62fe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:28.019546 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 124/247] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:55:28.040559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08212891-16ce-484e-822b-0f334a4386de None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:28.052491 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08212891-16ce-484e-822b-0f334a4386de None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:28.056181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34094663-9df3-4877-b070-8b535e8c0984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:28.056899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34094663-9df3-4877-b070-8b535e8c0984 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:28.057191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34094663-9df3-4877-b070-8b535e8c0984 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:28.057477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34094663-9df3-4877-b070-8b535e8c0984 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:28.069056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34094663-9df3-4877-b070-8b535e8c0984 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:28.075388 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-34094663-9df3-4877-b070-8b535e8c0984 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:55:28.076489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 124/248] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:28.082509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b39ae-b348-4295-a271-e1545c62fe2b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:28.091087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b39ae-b348-4295-a271-e1545c62fe2b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:28.095433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012782af-0796-47de-9543-9a113281f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:28.096022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012782af-0796-47de-9543-9a113281f970 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:28.096313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012782af-0796-47de-9543-9a113281f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:28.096597 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012782af-0796-47de-9543-9a113281f970 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:28.097299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012782af-0796-47de-9543-9a113281f970 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:28.097598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012782af-0796-47de-9543-9a113281f970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:28.123668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012782af-0796-47de-9543-9a113281f970 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:28.133224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 125/249] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:55:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:28.138741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34094663-9df3-4877-b070-8b535e8c0984 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:28.148928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34094663-9df3-4877-b070-8b535e8c0984 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:28.152712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceb76c-4aeb-41f4-bac2-c56db9144a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:28.153470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceb76c-4aeb-41f4-bac2-c56db9144a5c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:28.153756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceb76c-4aeb-41f4-bac2-c56db9144a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:28.154038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceb76c-4aeb-41f4-bac2-c56db9144a5c admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:28.155101 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceb76c-4aeb-41f4-bac2-c56db9144a5c admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:28.180733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceb76c-4aeb-41f4-bac2-c56db9144a5c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:28.182159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 125/250] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:28 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:28.187364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012782af-0796-47de-9543-9a113281f970 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:28.197287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012782af-0796-47de-9543-9a113281f970 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:28.201175 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62c85a-0887-4e4a-99dc-2baa6040e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:28.201953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62c85a-0887-4e4a-99dc-2baa6040e655 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:28.202249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62c85a-0887-4e4a-99dc-2baa6040e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:28.202538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62c85a-0887-4e4a-99dc-2baa6040e655 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:28.203695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62c85a-0887-4e4a-99dc-2baa6040e655 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:28.229090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62c85a-0887-4e4a-99dc-2baa6040e655 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:28.230697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 126/251] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:28 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:28.236933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceb76c-4aeb-41f4-bac2-c56db9144a5c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:28.246117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceb76c-4aeb-41f4-bac2-c56db9144a5c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:28.249871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb962d70-13cb-41e0-8e83-54f0f4944007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:28.251373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb962d70-13cb-41e0-8e83-54f0f4944007 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:28.251660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb962d70-13cb-41e0-8e83-54f0f4944007 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:28.251940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb962d70-13cb-41e0-8e83-54f0f4944007 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/groups/3956e0a259c24bcdbd9f3221696817bb/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:28.253620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb962d70-13cb-41e0-8e83-54f0f4944007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a7d1331b8144a19205ad2b0f3ce026, group_id=3956e0a259c24bcdbd9f3221696817bb, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:28.279464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb962d70-13cb-41e0-8e83-54f0f4944007 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:28.291631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 126/252] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Oct 27 13:55:28 2021] PUT /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/groups/3956e0a259c24bcdbd9f3221696817bb/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:55:30.269400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2953-07da-4c9f-8e7e-8965857844c1 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:30.269911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2953-07da-4c9f-8e7e-8965857844c1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:30.269911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2953-07da-4c9f-8e7e-8965857844c1 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:30.271580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 127/253] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:30.276647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cd8ec-539a-497e-a6b2-5e76e20b604e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:30.277061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cd8ec-539a-497e-a6b2-5e76e20b604e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:30.277231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cd8ec-539a-497e-a6b2-5e76e20b604e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:30.300252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-ec6cd8ec-539a-497e-a6b2-5e76e20b604e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:30.301387 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ec6cd8ec-539a-497e-a6b2-5e76e20b604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:30.369873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 127/254] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:30.391987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2953-07da-4c9f-8e7e-8965857844c1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:30.403540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2953-07da-4c9f-8e7e-8965857844c1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:30.407952 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bb521-d739-4d55-8368-7d45321779af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:30.408662 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bb521-d739-4d55-8368-7d45321779af admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:30.408961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bb521-d739-4d55-8368-7d45321779af admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:30.409246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bb521-d739-4d55-8368-7d45321779af admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:30.421095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bb521-d739-4d55-8368-7d45321779af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:30.427632 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-c03bb521-d739-4d55-8368-7d45321779af admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:55:30.428741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 128/255] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:30.434410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cd8ec-539a-497e-a6b2-5e76e20b604e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:30.443550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cd8ec-539a-497e-a6b2-5e76e20b604e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:30.447457 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49528b-672f-44a2-9640-030da6d6253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:30.448054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49528b-672f-44a2-9640-030da6d6253d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:30.448348 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49528b-672f-44a2-9640-030da6d6253d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:30.448634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49528b-672f-44a2-9640-030da6d6253d admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:30.449341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49528b-672f-44a2-9640-030da6d6253d admin admin] RBAC: Adding query filter params (name=member) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:30.449645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49528b-672f-44a2-9640-030da6d6253d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:30.476138 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49528b-672f-44a2-9640-030da6d6253d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:30.484634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 128/256] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:55:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:30.490748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bb521-d739-4d55-8368-7d45321779af admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:30.499920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bb521-d739-4d55-8368-7d45321779af admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:30.503766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85aff-cc79-46e5-8644-6bc258a16967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:30.504335 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85aff-cc79-46e5-8644-6bc258a16967 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:30.504622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85aff-cc79-46e5-8644-6bc258a16967 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:30.504905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85aff-cc79-46e5-8644-6bc258a16967 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:30.512526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c85aff-cc79-46e5-8644-6bc258a16967 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:30.538972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c85aff-cc79-46e5-8644-6bc258a16967 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:30.547571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 129/257] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:30.553663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49528b-672f-44a2-9640-030da6d6253d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:30.563448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49528b-672f-44a2-9640-030da6d6253d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:30.567401 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e6bb5-0da2-46f2-a087-5866071b9072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:30.568184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e6bb5-0da2-46f2-a087-5866071b9072 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:30.568473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e6bb5-0da2-46f2-a087-5866071b9072 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:30.568758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e6bb5-0da2-46f2-a087-5866071b9072 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:30.569839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e6bb5-0da2-46f2-a087-5866071b9072 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:30.596847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e6bb5-0da2-46f2-a087-5866071b9072 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:30.598354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 129/258] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:30 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:30.603550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85aff-cc79-46e5-8644-6bc258a16967 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:30.612250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85aff-cc79-46e5-8644-6bc258a16967 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:30.616191 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9734b1-077e-43cf-8eac-4302753a6d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:30.616950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9734b1-077e-43cf-8eac-4302753a6d9b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:30.617237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9734b1-077e-43cf-8eac-4302753a6d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:30.617518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9734b1-077e-43cf-8eac-4302753a6d9b admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:30.618542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9734b1-077e-43cf-8eac-4302753a6d9b admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:30.643841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-bc9734b1-077e-43cf-8eac-4302753a6d9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:55:30.643841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:55:30.643841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:55:30.644993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9734b1-077e-43cf-8eac-4302753a6d9b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:30.646416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 130/259] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:30 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:55:30.651919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e6bb5-0da2-46f2-a087-5866071b9072 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:30.661248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e6bb5-0da2-46f2-a087-5866071b9072 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:30.665245 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc7950-81c5-4029-8e0d-1abe5de23e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:30.665822 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc7950-81c5-4029-8e0d-1abe5de23e90 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:30.666117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc7950-81c5-4029-8e0d-1abe5de23e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:30.666406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc7950-81c5-4029-8e0d-1abe5de23e90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:30.667228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc7950-81c5-4029-8e0d-1abe5de23e90 admin admin] RBAC: Adding query filter params (group.id=3956e0a259c24bcdbd9f3221696817bb, role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:30.667541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc7950-81c5-4029-8e0d-1abe5de23e90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:30.693489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc7950-81c5-4029-8e0d-1abe5de23e90 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:30.699602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 130/260] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:30 2021] GET /identity/v3/role_assignments?group.id=3956e0a259c24bcdbd9f3221696817bb&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=871d3e9701f04be1906b8ef20b10077b => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:32.700940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3ef00-2f8f-4096-b81c-3950a5fa87a3 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:32.701495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3ef00-2f8f-4096-b81c-3950a5fa87a3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:32.701495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3ef00-2f8f-4096-b81c-3950a5fa87a3 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:32.703205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 131/261] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:32.709003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6381-44b8-463e-88a1-f05f0bc671fb None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:32.709385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6381-44b8-463e-88a1-f05f0bc671fb None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:32.709595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6381-44b8-463e-88a1-f05f0bc671fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:32.732279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-906b6381-44b8-463e-88a1-f05f0bc671fb None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:32.733408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-906b6381-44b8-463e-88a1-f05f0bc671fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:32.740792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 131/262] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:32.763047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3ef00-2f8f-4096-b81c-3950a5fa87a3 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:32.775199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3ef00-2f8f-4096-b81c-3950a5fa87a3 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:32.779322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b911d-8f7c-48d9-b866-c9b646ef6eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:32.780051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b911d-8f7c-48d9-b866-c9b646ef6eed admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:32.780341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b911d-8f7c-48d9-b866-c9b646ef6eed admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:32.780622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b911d-8f7c-48d9-b866-c9b646ef6eed admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:32.792829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b911d-8f7c-48d9-b866-c9b646ef6eed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:32.799695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-d22b911d-8f7c-48d9-b866-c9b646ef6eed admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:55:32.800779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 132/263] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:55:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:32.806262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b6381-44b8-463e-88a1-f05f0bc671fb None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:32.820640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b6381-44b8-463e-88a1-f05f0bc671fb None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:32.824761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ece155-c205-4f1a-8f79-da810c63f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:32.825361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ece155-c205-4f1a-8f79-da810c63f790 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:32.825651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ece155-c205-4f1a-8f79-da810c63f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:32.825935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ece155-c205-4f1a-8f79-da810c63f790 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:32.826793 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ece155-c205-4f1a-8f79-da810c63f790 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:32.826985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ece155-c205-4f1a-8f79-da810c63f790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:32.852712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ece155-c205-4f1a-8f79-da810c63f790 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:32.862204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 132/264] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:55:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:55:32.867876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b911d-8f7c-48d9-b866-c9b646ef6eed admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:32.880808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b911d-8f7c-48d9-b866-c9b646ef6eed admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:32.884763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ab867-0c9c-4a67-a398-4ba586527821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:32.885342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ab867-0c9c-4a67-a398-4ba586527821 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:32.885636 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ab867-0c9c-4a67-a398-4ba586527821 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:32.885919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ab867-0c9c-4a67-a398-4ba586527821 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:32.894544 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ab867-0c9c-4a67-a398-4ba586527821 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:32.919983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ab867-0c9c-4a67-a398-4ba586527821 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:32.928799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 133/265] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:32.935387 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ece155-c205-4f1a-8f79-da810c63f790 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:32.945531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ece155-c205-4f1a-8f79-da810c63f790 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:32.949477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6c35b-6b32-4a0b-9872-36c7e13438c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:32.950254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6c35b-6b32-4a0b-9872-36c7e13438c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:32.950547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6c35b-6b32-4a0b-9872-36c7e13438c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:32.950873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6c35b-6b32-4a0b-9872-36c7e13438c1 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:32.952001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6c35b-6b32-4a0b-9872-36c7e13438c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:32.978263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6c35b-6b32-4a0b-9872-36c7e13438c1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:32.979830 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 133/266] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:32 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:32.985064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ab867-0c9c-4a67-a398-4ba586527821 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:32.994010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ab867-0c9c-4a67-a398-4ba586527821 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:32.997990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3492-6892-423a-808f-2adaf0a0888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:32.998790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3492-6892-423a-808f-2adaf0a0888e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:32.999084 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3492-6892-423a-808f-2adaf0a0888e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:32.999368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3492-6892-423a-808f-2adaf0a0888e admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:33.000926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3492-6892-423a-808f-2adaf0a0888e admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:33.026818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3492-6892-423a-808f-2adaf0a0888e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:33.028312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 134/267] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:32 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:33.033929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6c35b-6b32-4a0b-9872-36c7e13438c1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:33.043510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6c35b-6b32-4a0b-9872-36c7e13438c1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:33.047432 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76d81-85e6-40dd-8dac-ecb1a19edc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:33.048053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76d81-85e6-40dd-8dac-ecb1a19edc4e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:33.048349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76d81-85e6-40dd-8dac-ecb1a19edc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:33.048637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76d81-85e6-40dd-8dac-ecb1a19edc4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:33.049407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76d81-85e6-40dd-8dac-ecb1a19edc4e admin admin] RBAC: Adding query filter params (group.id=3956e0a259c24bcdbd9f3221696817bb, role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:33.049719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76d81-85e6-40dd-8dac-ecb1a19edc4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:33.075655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76d81-85e6-40dd-8dac-ecb1a19edc4e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:33.081773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 134/268] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:33 2021] GET /identity/v3/role_assignments?group.id=3956e0a259c24bcdbd9f3221696817bb&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:35.002639 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92363-0a7c-4de1-a186-d6101ce18322 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:35.003216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92363-0a7c-4de1-a186-d6101ce18322 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:35.003216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92363-0a7c-4de1-a186-d6101ce18322 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:35.005028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 135/269] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:35.010207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209213-8f96-4cb9-9b41-f3e8b7a8072d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:35.010583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209213-8f96-4cb9-9b41-f3e8b7a8072d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:35.010819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209213-8f96-4cb9-9b41-f3e8b7a8072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:35.033702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-46209213-8f96-4cb9-9b41-f3e8b7a8072d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:35.034877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-46209213-8f96-4cb9-9b41-f3e8b7a8072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:35.041415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 135/270] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:55:35.064008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92363-0a7c-4de1-a186-d6101ce18322 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:35.075610 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92363-0a7c-4de1-a186-d6101ce18322 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:35.079435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee91893-7c26-4f4d-8eb2-9cf4397c9fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:35.080167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee91893-7c26-4f4d-8eb2-9cf4397c9fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:35.080456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee91893-7c26-4f4d-8eb2-9cf4397c9fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:35.080738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee91893-7c26-4f4d-8eb2-9cf4397c9fb3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:35.091761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee91893-7c26-4f4d-8eb2-9cf4397c9fb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:35.098301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-8ee91893-7c26-4f4d-8eb2-9cf4397c9fb3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:55:35.099406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 136/271] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:55:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:35.105009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209213-8f96-4cb9-9b41-f3e8b7a8072d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:35.114539 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209213-8f96-4cb9-9b41-f3e8b7a8072d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:35.118444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05957b88-c4a7-437b-ba76-2a91ef058e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:35.119061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05957b88-c4a7-437b-ba76-2a91ef058e8d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:35.119358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05957b88-c4a7-437b-ba76-2a91ef058e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:35.119628 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05957b88-c4a7-437b-ba76-2a91ef058e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:35.120326 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05957b88-c4a7-437b-ba76-2a91ef058e8d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:35.120696 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05957b88-c4a7-437b-ba76-2a91ef058e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:35.146353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05957b88-c4a7-437b-ba76-2a91ef058e8d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:35.154922 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 136/272] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:55:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:35.160373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee91893-7c26-4f4d-8eb2-9cf4397c9fb3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:35.170545 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee91893-7c26-4f4d-8eb2-9cf4397c9fb3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:35.175603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d33b3-7b3e-4e16-95d0-90329607e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:35.176375 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d33b3-7b3e-4e16-95d0-90329607e1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:35.176668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d33b3-7b3e-4e16-95d0-90329607e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:35.176953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d33b3-7b3e-4e16-95d0-90329607e1d1 admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:35.177995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d33b3-7b3e-4e16-95d0-90329607e1d1 admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:35.203772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d33b3-7b3e-4e16-95d0-90329607e1d1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:35.205220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 137/273] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:35 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:35.210556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05957b88-c4a7-437b-ba76-2a91ef058e8d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:35.219872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05957b88-c4a7-437b-ba76-2a91ef058e8d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:35.223780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd184d8-595a-4394-81f3-dab2c7c1b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:35.224553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd184d8-595a-4394-81f3-dab2c7c1b180 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:35.224845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd184d8-595a-4394-81f3-dab2c7c1b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:35.225132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd184d8-595a-4394-81f3-dab2c7c1b180 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:35.226201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd184d8-595a-4394-81f3-dab2c7c1b180 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:35.253739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd184d8-595a-4394-81f3-dab2c7c1b180 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:35.255252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 137/274] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:35 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:35.260732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d33b3-7b3e-4e16-95d0-90329607e1d1 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:35.270057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d33b3-7b3e-4e16-95d0-90329607e1d1 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:35.274362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796714-6c49-4ba9-89aa-decc567c63d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:35.275196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796714-6c49-4ba9-89aa-decc567c63d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:35.275489 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796714-6c49-4ba9-89aa-decc567c63d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:35.275773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796714-6c49-4ba9-89aa-decc567c63d6 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/groups/3956e0a259c24bcdbd9f3221696817bb/roles/886f966104ce425fa75dbe7ee88aba33` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:35.277694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8796714-6c49-4ba9-89aa-decc567c63d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a7d1331b8144a19205ad2b0f3ce026, group_id=3956e0a259c24bcdbd9f3221696817bb, role_id=886f966104ce425fa75dbe7ee88aba33)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:35.304234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8796714-6c49-4ba9-89aa-decc567c63d6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:35.318163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 138/275] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Oct 27 13:55:35 2021] PUT /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026/groups/3956e0a259c24bcdbd9f3221696817bb/roles/886f966104ce425fa75dbe7ee88aba33 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:55:37.274011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e02cc-cea8-49f9-8c83-8f95753c67c4 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:37.274519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e02cc-cea8-49f9-8c83-8f95753c67c4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:37.274519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e02cc-cea8-49f9-8c83-8f95753c67c4 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:37.276200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 138/276] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:37.281211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54988f-fa4b-4ed2-b77a-f16d0748bfa1 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:37.282161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54988f-fa4b-4ed2-b77a-f16d0748bfa1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:37.282318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54988f-fa4b-4ed2-b77a-f16d0748bfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:37.306352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5b54988f-fa4b-4ed2-b77a-f16d0748bfa1 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:37.307523 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5b54988f-fa4b-4ed2-b77a-f16d0748bfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:37.370770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 139/277] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:37.393040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e02cc-cea8-49f9-8c83-8f95753c67c4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:37.404335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e02cc-cea8-49f9-8c83-8f95753c67c4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:37.408811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219ca0d-60a3-401b-b40b-1ff2cb164dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:37.409538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219ca0d-60a3-401b-b40b-1ff2cb164dab admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:37.409822 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219ca0d-60a3-401b-b40b-1ff2cb164dab admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:37.410107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219ca0d-60a3-401b-b40b-1ff2cb164dab admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:37.423141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219ca0d-60a3-401b-b40b-1ff2cb164dab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:37.429760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e219ca0d-60a3-401b-b40b-1ff2cb164dab admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:55:37.430882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 139/278] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:55:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:37.436672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54988f-fa4b-4ed2-b77a-f16d0748bfa1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:37.445318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54988f-fa4b-4ed2-b77a-f16d0748bfa1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:37.449338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385acfee-6b01-4dbb-890a-e86ab8fed645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:37.449934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385acfee-6b01-4dbb-890a-e86ab8fed645 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:37.450224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385acfee-6b01-4dbb-890a-e86ab8fed645 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:37.450523 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385acfee-6b01-4dbb-890a-e86ab8fed645 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:37.451243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385acfee-6b01-4dbb-890a-e86ab8fed645 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:37.451544 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385acfee-6b01-4dbb-890a-e86ab8fed645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:37.477539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385acfee-6b01-4dbb-890a-e86ab8fed645 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:37.486483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 140/279] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:55:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:37.491933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219ca0d-60a3-401b-b40b-1ff2cb164dab admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:37.501111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219ca0d-60a3-401b-b40b-1ff2cb164dab admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:37.504887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f70662-1048-4f66-a9eb-6d644a3809f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:37.505449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70662-1048-4f66-a9eb-6d644a3809f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:37.505734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70662-1048-4f66-a9eb-6d644a3809f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:37.506011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70662-1048-4f66-a9eb-6d644a3809f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:37.513548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f70662-1048-4f66-a9eb-6d644a3809f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:37.539887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f70662-1048-4f66-a9eb-6d644a3809f6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:37.548173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 140/280] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:37.553607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385acfee-6b01-4dbb-890a-e86ab8fed645 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:37.562936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385acfee-6b01-4dbb-890a-e86ab8fed645 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:37.566888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac710a-b465-47ae-93dd-dda8d5fd8750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:37.567670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac710a-b465-47ae-93dd-dda8d5fd8750 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:37.567964 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac710a-b465-47ae-93dd-dda8d5fd8750 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:37.568249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac710a-b465-47ae-93dd-dda8d5fd8750 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:37.569310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac710a-b465-47ae-93dd-dda8d5fd8750 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:37.595972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac710a-b465-47ae-93dd-dda8d5fd8750 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:37.597467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 141/281] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:37 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:37.602708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f70662-1048-4f66-a9eb-6d644a3809f6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:37.612221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f70662-1048-4f66-a9eb-6d644a3809f6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:37.616544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac1e42-725a-4a6f-8e70-31ff0b6db579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:37.617324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac1e42-725a-4a6f-8e70-31ff0b6db579 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:37.617608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac1e42-725a-4a6f-8e70-31ff0b6db579 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:37.617881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac1e42-725a-4a6f-8e70-31ff0b6db579 admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:37.618965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac1e42-725a-4a6f-8e70-31ff0b6db579 admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:37.645653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac1e42-725a-4a6f-8e70-31ff0b6db579 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:37.647173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 141/282] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:37 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:37.652830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac710a-b465-47ae-93dd-dda8d5fd8750 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:37.662885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac710a-b465-47ae-93dd-dda8d5fd8750 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:37.666730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3afe-3a23-446f-837e-8182787f0b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:37.667310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3afe-3a23-446f-837e-8182787f0b2e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:37.667603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3afe-3a23-446f-837e-8182787f0b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:37.667890 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3afe-3a23-446f-837e-8182787f0b2e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:37.668664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c3afe-3a23-446f-837e-8182787f0b2e admin admin] RBAC: Adding query filter params (group.id=3956e0a259c24bcdbd9f3221696817bb, role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:37.668970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c3afe-3a23-446f-837e-8182787f0b2e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:37.695074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c3afe-3a23-446f-837e-8182787f0b2e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:37.700794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 142/283] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:37 2021] GET /identity/v3/role_assignments?group.id=3956e0a259c24bcdbd9f3221696817bb&scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:39.673047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ec72-9433-41a7-a5fc-ab7f62bd7d6a None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:39.673576 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ec72-9433-41a7-a5fc-ab7f62bd7d6a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:39.673691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ec72-9433-41a7-a5fc-ab7f62bd7d6a None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:39.675339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 142/284] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:39.680543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccc6f9-7795-4668-b52a-8a4b1388c5f2 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:39.680956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccc6f9-7795-4668-b52a-8a4b1388c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:39.681116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccc6f9-7795-4668-b52a-8a4b1388c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:39.705233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-f3ccc6f9-7795-4668-b52a-8a4b1388c5f2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:39.706367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-f3ccc6f9-7795-4668-b52a-8a4b1388c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:39.712992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 143/285] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:39.735556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ec72-9433-41a7-a5fc-ab7f62bd7d6a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:39.747278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ec72-9433-41a7-a5fc-ab7f62bd7d6a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:39.751188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12103a45-5c26-44bd-8f46-9a547d30e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:39.751906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12103a45-5c26-44bd-8f46-9a547d30e964 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:39.752194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12103a45-5c26-44bd-8f46-9a547d30e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:39.752474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12103a45-5c26-44bd-8f46-9a547d30e964 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:39.763355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12103a45-5c26-44bd-8f46-9a547d30e964 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:39.770252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-12103a45-5c26-44bd-8f46-9a547d30e964 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:55:39.771344 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 143/286] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:39.776867 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccc6f9-7795-4668-b52a-8a4b1388c5f2 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:39.786242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccc6f9-7795-4668-b52a-8a4b1388c5f2 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:39.790240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6a452-9527-4cdb-ae65-2145806200e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:39.790871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6a452-9527-4cdb-ae65-2145806200e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:39.791166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6a452-9527-4cdb-ae65-2145806200e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:39.791451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6a452-9527-4cdb-ae65-2145806200e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:39.792157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6a452-9527-4cdb-ae65-2145806200e8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:39.792459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6a452-9527-4cdb-ae65-2145806200e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:39.817649 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6a452-9527-4cdb-ae65-2145806200e8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:39.826732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 144/287] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:55:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:39.833158 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12103a45-5c26-44bd-8f46-9a547d30e964 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:39.843454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12103a45-5c26-44bd-8f46-9a547d30e964 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:39.848105 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad88a9-bd1a-4d43-9993-ec4fc7dfdb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:39.848677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad88a9-bd1a-4d43-9993-ec4fc7dfdb3d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:39.848970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad88a9-bd1a-4d43-9993-ec4fc7dfdb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:39.849253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad88a9-bd1a-4d43-9993-ec4fc7dfdb3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:39.857019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad88a9-bd1a-4d43-9993-ec4fc7dfdb3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:39.885936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad88a9-bd1a-4d43-9993-ec4fc7dfdb3d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:39.895696 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 144/288] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:39.901368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6a452-9527-4cdb-ae65-2145806200e8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:39.911955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6a452-9527-4cdb-ae65-2145806200e8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:39.915853 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db342-9c98-426d-b539-c4c2da01bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:39.916635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db342-9c98-426d-b539-c4c2da01bc06 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:39.916927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db342-9c98-426d-b539-c4c2da01bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:39.917214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db342-9c98-426d-b539-c4c2da01bc06 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:39.918302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db342-9c98-426d-b539-c4c2da01bc06 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:39.944702 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db342-9c98-426d-b539-c4c2da01bc06 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:39.946158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 145/289] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:39 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:39.951587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad88a9-bd1a-4d43-9993-ec4fc7dfdb3d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:39.961019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad88a9-bd1a-4d43-9993-ec4fc7dfdb3d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:39.966672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660a426-8961-4347-9b71-3f1d144970c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:39.967460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660a426-8961-4347-9b71-3f1d144970c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:39.967752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660a426-8961-4347-9b71-3f1d144970c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:39.968038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660a426-8961-4347-9b71-3f1d144970c8 admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:39.969171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660a426-8961-4347-9b71-3f1d144970c8 admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:39.994848 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660a426-8961-4347-9b71-3f1d144970c8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:39.996324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 145/290] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:39 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:40.002355 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db342-9c98-426d-b539-c4c2da01bc06 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:40.012794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db342-9c98-426d-b539-c4c2da01bc06 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:40.017416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d2a5e-2814-4f2b-80b7-8d363da8f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:40.017992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2a5e-2814-4f2b-80b7-8d363da8f66f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:40.018287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2a5e-2814-4f2b-80b7-8d363da8f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:40.018576 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d2a5e-2814-4f2b-80b7-8d363da8f66f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:40.019402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d2a5e-2814-4f2b-80b7-8d363da8f66f admin admin] RBAC: Adding query filter params (group.id=3956e0a259c24bcdbd9f3221696817bb, role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=833020c6e97d4c80bbe449fc92e597a4) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:40.019713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d2a5e-2814-4f2b-80b7-8d363da8f66f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:40.044980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d2a5e-2814-4f2b-80b7-8d363da8f66f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:40.050422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 146/291] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:40 2021] GET /identity/v3/role_assignments?group.id=3956e0a259c24bcdbd9f3221696817bb&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=871d3e9701f04be1906b8ef20b10077b => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:41.981035 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227c22-b758-4088-ab3a-5caf73f4fc0e None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:41.981550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227c22-b758-4088-ab3a-5caf73f4fc0e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:41.981634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227c22-b758-4088-ab3a-5caf73f4fc0e None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:41.983317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 146/292] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:41.989303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60238cf-0774-4f49-a790-b75e1c9a3f4d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:41.989747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60238cf-0774-4f49-a790-b75e1c9a3f4d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:41.989891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60238cf-0774-4f49-a790-b75e1c9a3f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:42.011967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c60238cf-0774-4f49-a790-b75e1c9a3f4d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:42.013097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c60238cf-0774-4f49-a790-b75e1c9a3f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:42.020287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 147/293] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:42.041943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227c22-b758-4088-ab3a-5caf73f4fc0e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:42.053274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227c22-b758-4088-ab3a-5caf73f4fc0e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:42.056976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38c626-9b6f-4b43-9585-bbe8db541b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:42.057684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c626-9b6f-4b43-9585-bbe8db541b73 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:42.057973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c626-9b6f-4b43-9585-bbe8db541b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:42.058254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38c626-9b6f-4b43-9585-bbe8db541b73 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:42.069159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38c626-9b6f-4b43-9585-bbe8db541b73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:42.075429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-bd38c626-9b6f-4b43-9585-bbe8db541b73 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:55:42.076479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 147/294] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:42.082648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60238cf-0774-4f49-a790-b75e1c9a3f4d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:42.091209 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60238cf-0774-4f49-a790-b75e1c9a3f4d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:42.096133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bc0a3-142f-41d0-8f26-3a73d4002e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:42.096728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bc0a3-142f-41d0-8f26-3a73d4002e20 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:42.097019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bc0a3-142f-41d0-8f26-3a73d4002e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:42.097303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bc0a3-142f-41d0-8f26-3a73d4002e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:42.098012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bc0a3-142f-41d0-8f26-3a73d4002e20 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:42.098321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bc0a3-142f-41d0-8f26-3a73d4002e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:42.123660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bc0a3-142f-41d0-8f26-3a73d4002e20 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:42.132792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 148/295] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:55:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:55:42.138331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38c626-9b6f-4b43-9585-bbe8db541b73 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:42.148940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38c626-9b6f-4b43-9585-bbe8db541b73 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:42.152749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d4624-80d7-4253-a4ed-e967b1ec9835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:42.153517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d4624-80d7-4253-a4ed-e967b1ec9835 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:42.153803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d4624-80d7-4253-a4ed-e967b1ec9835 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:42.154084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d4624-80d7-4253-a4ed-e967b1ec9835 admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:42.155146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d4624-80d7-4253-a4ed-e967b1ec9835 admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:42.181047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d4624-80d7-4253-a4ed-e967b1ec9835 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:42.182483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 148/296] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:42 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:42.188279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bc0a3-142f-41d0-8f26-3a73d4002e20 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:42.197582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bc0a3-142f-41d0-8f26-3a73d4002e20 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:42.201413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe33a8-9000-4bf6-a866-e000e9a648e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:42.202275 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe33a8-9000-4bf6-a866-e000e9a648e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:42.202472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe33a8-9000-4bf6-a866-e000e9a648e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:42.202787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe33a8-9000-4bf6-a866-e000e9a648e6 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:42.205292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe33a8-9000-4bf6-a866-e000e9a648e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:42.235460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe33a8-9000-4bf6-a866-e000e9a648e6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:42.237225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 149/297] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:42 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:55:42.243917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d4624-80d7-4253-a4ed-e967b1ec9835 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:42.255198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d4624-80d7-4253-a4ed-e967b1ec9835 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:42.260008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985e87-3640-4c64-ab46-2edacb380e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:42.261436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985e87-3640-4c64-ab46-2edacb380e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:42.261743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985e87-3640-4c64-ab46-2edacb380e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:42.262032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985e87-3640-4c64-ab46-2edacb380e21 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4/groups/3956e0a259c24bcdbd9f3221696817bb/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:42.263776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d985e87-3640-4c64-ab46-2edacb380e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833020c6e97d4c80bbe449fc92e597a4, group_id=3956e0a259c24bcdbd9f3221696817bb, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:42.290758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d985e87-3640-4c64-ab46-2edacb380e21 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:42.302991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 149/298] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Oct 27 13:55:42 2021] PUT /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4/groups/3956e0a259c24bcdbd9f3221696817bb/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:55:44.233168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76632d4-bd4c-49b4-81c9-943cea30a7b1 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:44.233683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76632d4-bd4c-49b4-81c9-943cea30a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:44.233770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76632d4-bd4c-49b4-81c9-943cea30a7b1 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:44.236261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 150/299] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:44.241217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e0348-bafd-4a1a-ac73-c80a5512b165 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:44.241618 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e0348-bafd-4a1a-ac73-c80a5512b165 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:44.241799 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e0348-bafd-4a1a-ac73-c80a5512b165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:44.264646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-f44e0348-bafd-4a1a-ac73-c80a5512b165 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:44.265737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f44e0348-bafd-4a1a-ac73-c80a5512b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:44.328532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 150/300] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:44.350474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76632d4-bd4c-49b4-81c9-943cea30a7b1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:44.362990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76632d4-bd4c-49b4-81c9-943cea30a7b1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:44.366752 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82613d9c-4e19-4cae-a41e-204f67edcfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:44.367467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82613d9c-4e19-4cae-a41e-204f67edcfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:44.367754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82613d9c-4e19-4cae-a41e-204f67edcfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:44.368032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82613d9c-4e19-4cae-a41e-204f67edcfa1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:44.380436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82613d9c-4e19-4cae-a41e-204f67edcfa1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:44.386721 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-82613d9c-4e19-4cae-a41e-204f67edcfa1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 13:55:44.387812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 151/301] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:44.393644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e0348-bafd-4a1a-ac73-c80a5512b165 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:44.402200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e0348-bafd-4a1a-ac73-c80a5512b165 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:44.406052 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dfcad-c325-410a-829a-b67a16dc8544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:44.407524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dfcad-c325-410a-829a-b67a16dc8544 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:44.407860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dfcad-c325-410a-829a-b67a16dc8544 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:44.408150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dfcad-c325-410a-829a-b67a16dc8544 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:44.408857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dfcad-c325-410a-829a-b67a16dc8544 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:44.409161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dfcad-c325-410a-829a-b67a16dc8544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:44.435047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dfcad-c325-410a-829a-b67a16dc8544 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:44.443872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 151/302] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:55:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:44.449405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82613d9c-4e19-4cae-a41e-204f67edcfa1 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:44.458806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82613d9c-4e19-4cae-a41e-204f67edcfa1 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:44.462598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad673-14fa-4f24-9236-656c394cf158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:44.463204 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad673-14fa-4f24-9236-656c394cf158 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:44.463496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad673-14fa-4f24-9236-656c394cf158 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:44.463783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad673-14fa-4f24-9236-656c394cf158 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:44.471817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cad673-14fa-4f24-9236-656c394cf158 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:44.497902 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cad673-14fa-4f24-9236-656c394cf158 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:44.506837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 152/303] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:44.512353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dfcad-c325-410a-829a-b67a16dc8544 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:44.521979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dfcad-c325-410a-829a-b67a16dc8544 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:44.525768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453a988-3f1e-4477-b41f-e629fb603e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:44.526557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453a988-3f1e-4477-b41f-e629fb603e28 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:44.526879 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453a988-3f1e-4477-b41f-e629fb603e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:44.527169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453a988-3f1e-4477-b41f-e629fb603e28 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:44.528241 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453a988-3f1e-4477-b41f-e629fb603e28 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:44.555229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453a988-3f1e-4477-b41f-e629fb603e28 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:44.556730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 152/304] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:44 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:44.561987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad673-14fa-4f24-9236-656c394cf158 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:44.570665 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad673-14fa-4f24-9236-656c394cf158 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:44.574545 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9523f32-6f85-469f-a13c-755cbb8965a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:44.575363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9523f32-6f85-469f-a13c-755cbb8965a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:44.575657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9523f32-6f85-469f-a13c-755cbb8965a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:44.575944 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9523f32-6f85-469f-a13c-755cbb8965a5 admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:44.577022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9523f32-6f85-469f-a13c-755cbb8965a5 admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:44.607882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9523f32-6f85-469f-a13c-755cbb8965a5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:44.610022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 153/305] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:44 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:44.615745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453a988-3f1e-4477-b41f-e629fb603e28 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:44.625027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453a988-3f1e-4477-b41f-e629fb603e28 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:44.628995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f3d4e-fa62-4415-9367-df6bb5b8fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:44.629570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f3d4e-fa62-4415-9367-df6bb5b8fb31 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:44.629860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f3d4e-fa62-4415-9367-df6bb5b8fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:44.630143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f3d4e-fa62-4415-9367-df6bb5b8fb31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:44.630951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f3d4e-fa62-4415-9367-df6bb5b8fb31 admin admin] RBAC: Adding query filter params (group.id=3956e0a259c24bcdbd9f3221696817bb, role.id=871d3e9701f04be1906b8ef20b10077b, scope.project.id=833020c6e97d4c80bbe449fc92e597a4) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:44.631258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f3d4e-fa62-4415-9367-df6bb5b8fb31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:44.656726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f3d4e-fa62-4415-9367-df6bb5b8fb31 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:44.662379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 153/306] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:44 2021] GET /identity/v3/role_assignments?group.id=3956e0a259c24bcdbd9f3221696817bb&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=871d3e9701f04be1906b8ef20b10077b => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:46.655887 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f414d-dd9a-4e31-90e7-87077cad62e7 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:46.656433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f414d-dd9a-4e31-90e7-87077cad62e7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:46.656433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f414d-dd9a-4e31-90e7-87077cad62e7 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:46.658352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 154/307] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:46.663589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f3e18-f14a-424e-8540-7dcd0761baab None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:46.664007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f3e18-f14a-424e-8540-7dcd0761baab None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:46.664176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f3e18-f14a-424e-8540-7dcd0761baab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:46.686808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-ac1f3e18-f14a-424e-8540-7dcd0761baab None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:46.688491 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ac1f3e18-f14a-424e-8540-7dcd0761baab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:46.694988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 154/308] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:46.716236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f414d-dd9a-4e31-90e7-87077cad62e7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:46.727668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f414d-dd9a-4e31-90e7-87077cad62e7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:46.731363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b41df-dbfc-445e-a5f3-28ed92d36517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:46.732090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b41df-dbfc-445e-a5f3-28ed92d36517 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:46.732376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b41df-dbfc-445e-a5f3-28ed92d36517 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:46.732658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b41df-dbfc-445e-a5f3-28ed92d36517 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:46.744267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b41df-dbfc-445e-a5f3-28ed92d36517 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:46.751460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-f21b41df-dbfc-445e-a5f3-28ed92d36517 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:55:46.752510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 155/309] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:55:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:46.757982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f3e18-f14a-424e-8540-7dcd0761baab None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:46.766668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f3e18-f14a-424e-8540-7dcd0761baab None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:46.770651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b87981-eef7-401c-9e1e-9ca18b28a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:46.771255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b87981-eef7-401c-9e1e-9ca18b28a0cf admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:46.771548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b87981-eef7-401c-9e1e-9ca18b28a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:46.771833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b87981-eef7-401c-9e1e-9ca18b28a0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:46.772654 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b87981-eef7-401c-9e1e-9ca18b28a0cf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:46.772961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b87981-eef7-401c-9e1e-9ca18b28a0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:46.799335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b87981-eef7-401c-9e1e-9ca18b28a0cf admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:46.807897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 155/310] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:55:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:55:46.813925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b41df-dbfc-445e-a5f3-28ed92d36517 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:46.824923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b41df-dbfc-445e-a5f3-28ed92d36517 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:46.829041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27afc-82ea-484d-9548-3c95a18e37d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:46.829615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27afc-82ea-484d-9548-3c95a18e37d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:46.829907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27afc-82ea-484d-9548-3c95a18e37d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:46.830195 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27afc-82ea-484d-9548-3c95a18e37d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:46.838029 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd27afc-82ea-484d-9548-3c95a18e37d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:46.864168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd27afc-82ea-484d-9548-3c95a18e37d1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:46.873035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 156/311] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:55:46.880457 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b87981-eef7-401c-9e1e-9ca18b28a0cf admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:46.889761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b87981-eef7-401c-9e1e-9ca18b28a0cf admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:46.893793 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ce0f4-b922-46b3-81a2-31b167f376b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:46.894578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ce0f4-b922-46b3-81a2-31b167f376b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:46.894900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ce0f4-b922-46b3-81a2-31b167f376b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:46.895191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ce0f4-b922-46b3-81a2-31b167f376b2 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:46.896261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ce0f4-b922-46b3-81a2-31b167f376b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:46.922344 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ce0f4-b922-46b3-81a2-31b167f376b2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:46.923841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 156/312] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:46 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:46.929350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27afc-82ea-484d-9548-3c95a18e37d1 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:46.938482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27afc-82ea-484d-9548-3c95a18e37d1 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:46.943459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4a429-b41b-4d6c-8e61-22a7a62ad650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:46.944224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4a429-b41b-4d6c-8e61-22a7a62ad650 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:46.944512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4a429-b41b-4d6c-8e61-22a7a62ad650 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:46.944788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4a429-b41b-4d6c-8e61-22a7a62ad650 admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:46.945822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4a429-b41b-4d6c-8e61-22a7a62ad650 admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:46.971485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4a429-b41b-4d6c-8e61-22a7a62ad650 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:46.973340 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 157/313] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:46 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:46.978909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ce0f4-b922-46b3-81a2-31b167f376b2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:46.989535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ce0f4-b922-46b3-81a2-31b167f376b2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:46.993415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca79934-2994-4812-b3eb-42f63b54f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:46.993978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79934-2994-4812-b3eb-42f63b54f3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:46.994269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79934-2994-4812-b3eb-42f63b54f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:46.994554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79934-2994-4812-b3eb-42f63b54f3b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:46.995362 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca79934-2994-4812-b3eb-42f63b54f3b9 admin admin] RBAC: Adding query filter params (group.id=3956e0a259c24bcdbd9f3221696817bb, role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=833020c6e97d4c80bbe449fc92e597a4) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:46.995665 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca79934-2994-4812-b3eb-42f63b54f3b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:47.021448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca79934-2994-4812-b3eb-42f63b54f3b9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:47.027044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 157/314] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:46 2021] GET /identity/v3/role_assignments?group.id=3956e0a259c24bcdbd9f3221696817bb&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:55:48.956560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b66ac-e227-4a75-a7a7-dd3561430db4 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:48.957155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b66ac-e227-4a75-a7a7-dd3561430db4 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:48.957565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b66ac-e227-4a75-a7a7-dd3561430db4 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:48.959285 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 158/315] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:48.964643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f99748-c101-45cc-94ce-77995a8a8d35 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:48.965021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f99748-c101-45cc-94ce-77995a8a8d35 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:48.965218 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f99748-c101-45cc-94ce-77995a8a8d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:48.988627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-71f99748-c101-45cc-94ce-77995a8a8d35 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:48.989748 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-71f99748-c101-45cc-94ce-77995a8a8d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:48.996455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 158/316] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:49.018693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b66ac-e227-4a75-a7a7-dd3561430db4 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:49.030129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b66ac-e227-4a75-a7a7-dd3561430db4 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:49.034645 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30268e-ba5d-477f-b0c2-8862d04e85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:49.035374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30268e-ba5d-477f-b0c2-8862d04e85a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:49.035664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30268e-ba5d-477f-b0c2-8862d04e85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:49.035945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30268e-ba5d-477f-b0c2-8862d04e85a6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:49.046970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30268e-ba5d-477f-b0c2-8862d04e85a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:49.053575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-5c30268e-ba5d-477f-b0c2-8862d04e85a6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:55:49.054651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 159/317] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:55:49 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:55:49.060333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f99748-c101-45cc-94ce-77995a8a8d35 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:49.069017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f99748-c101-45cc-94ce-77995a8a8d35 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:49.073039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d8fd4-9e83-43b0-9113-50801fb9a765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:49.073728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d8fd4-9e83-43b0-9113-50801fb9a765 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:49.074023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d8fd4-9e83-43b0-9113-50801fb9a765 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:49.074343 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d8fd4-9e83-43b0-9113-50801fb9a765 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:49.075094 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d8fd4-9e83-43b0-9113-50801fb9a765 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:49.075399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d8fd4-9e83-43b0-9113-50801fb9a765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:49.101782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d8fd4-9e83-43b0-9113-50801fb9a765 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:49.111178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 159/318] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:55:49 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:49.116740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30268e-ba5d-477f-b0c2-8862d04e85a6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:49.127003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30268e-ba5d-477f-b0c2-8862d04e85a6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:49.130858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b043a1-3c3f-47d3-9093-780f9214f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:49.131621 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b043a1-3c3f-47d3-9093-780f9214f9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:49.131909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b043a1-3c3f-47d3-9093-780f9214f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:49.132187 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b043a1-3c3f-47d3-9093-780f9214f9c8 admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:49.133216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b043a1-3c3f-47d3-9093-780f9214f9c8 admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:49.159494 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b043a1-3c3f-47d3-9093-780f9214f9c8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:49.160960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 160/319] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:49 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:49.166285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d8fd4-9e83-43b0-9113-50801fb9a765 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:49.175725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d8fd4-9e83-43b0-9113-50801fb9a765 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:49.179606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ade695-7ff3-46f7-9b59-359d3b971363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:49.180384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ade695-7ff3-46f7-9b59-359d3b971363 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:49.180672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ade695-7ff3-46f7-9b59-359d3b971363 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:49.180956 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ade695-7ff3-46f7-9b59-359d3b971363 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:49.182022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ade695-7ff3-46f7-9b59-359d3b971363 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:49.207963 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ade695-7ff3-46f7-9b59-359d3b971363 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:49.209419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 160/320] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:49 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:49.214799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b043a1-3c3f-47d3-9093-780f9214f9c8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:49.225207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b043a1-3c3f-47d3-9093-780f9214f9c8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:49.229121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57596e-e13e-4e4a-9b63-47f53ff42112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:49.229923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57596e-e13e-4e4a-9b63-47f53ff42112 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:49.230219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57596e-e13e-4e4a-9b63-47f53ff42112 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:49.230501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57596e-e13e-4e4a-9b63-47f53ff42112 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4/groups/3956e0a259c24bcdbd9f3221696817bb/roles/886f966104ce425fa75dbe7ee88aba33` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:49.232589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57596e-e13e-4e4a-9b63-47f53ff42112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833020c6e97d4c80bbe449fc92e597a4, group_id=3956e0a259c24bcdbd9f3221696817bb, role_id=886f966104ce425fa75dbe7ee88aba33)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:49.259153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57596e-e13e-4e4a-9b63-47f53ff42112 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:49.272536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 161/321] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Oct 27 13:55:49 2021] PUT /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4/groups/3956e0a259c24bcdbd9f3221696817bb/roles/886f966104ce425fa75dbe7ee88aba33 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:55:51.204391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dfbdd-f47d-44de-9b25-78ff95918d0f None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:51.204912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dfbdd-f47d-44de-9b25-78ff95918d0f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:51.205028 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dfbdd-f47d-44de-9b25-78ff95918d0f None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:51.206604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 161/322] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:51.211872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66992cfb-b1a4-4ff4-bb9e-ab09bce530b8 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:51.212285 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66992cfb-b1a4-4ff4-bb9e-ab09bce530b8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:51.212431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66992cfb-b1a4-4ff4-bb9e-ab09bce530b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:51.235174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-66992cfb-b1a4-4ff4-bb9e-ab09bce530b8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:51.236563 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-66992cfb-b1a4-4ff4-bb9e-ab09bce530b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:51.301470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 162/323] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:55:51.323324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dfbdd-f47d-44de-9b25-78ff95918d0f None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:51.335965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dfbdd-f47d-44de-9b25-78ff95918d0f None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:51.339799 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeafabf-5dd9-4155-80aa-7f7041475f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:51.340536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeafabf-5dd9-4155-80aa-7f7041475f72 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:51.340824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeafabf-5dd9-4155-80aa-7f7041475f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:51.341106 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeafabf-5dd9-4155-80aa-7f7041475f72 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:51.353840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeafabf-5dd9-4155-80aa-7f7041475f72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:51.360695 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-cdeafabf-5dd9-4155-80aa-7f7041475f72 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:55:51.362050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 162/324] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:55:51 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:51.367844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66992cfb-b1a4-4ff4-bb9e-ab09bce530b8 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:51.376680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66992cfb-b1a4-4ff4-bb9e-ab09bce530b8 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:51.380682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f46bc5-77de-4ce3-81b7-0b5c60520514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:51.381275 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f46bc5-77de-4ce3-81b7-0b5c60520514 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:51.381570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f46bc5-77de-4ce3-81b7-0b5c60520514 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:51.381858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f46bc5-77de-4ce3-81b7-0b5c60520514 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:51.382571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f46bc5-77de-4ce3-81b7-0b5c60520514 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:51.382905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f46bc5-77de-4ce3-81b7-0b5c60520514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:51.409311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f46bc5-77de-4ce3-81b7-0b5c60520514 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:51.418299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 163/325] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:55:51 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:51.424058 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeafabf-5dd9-4155-80aa-7f7041475f72 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:51.433312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeafabf-5dd9-4155-80aa-7f7041475f72 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:51.437945 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4252992-0b85-4505-a5f4-4f88a90cbc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:51.438686 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4252992-0b85-4505-a5f4-4f88a90cbc69 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:51.439024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4252992-0b85-4505-a5f4-4f88a90cbc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:51.439384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4252992-0b85-4505-a5f4-4f88a90cbc69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:51.447937 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4252992-0b85-4505-a5f4-4f88a90cbc69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:51.474388 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4252992-0b85-4505-a5f4-4f88a90cbc69 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:51.483342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 163/326] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:51.489276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f46bc5-77de-4ce3-81b7-0b5c60520514 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:51.498705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f46bc5-77de-4ce3-81b7-0b5c60520514 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:51.502919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f0764-9931-4cc2-91b6-82dd80190a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:51.503706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0764-9931-4cc2-91b6-82dd80190a94 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:51.504000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0764-9931-4cc2-91b6-82dd80190a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:51.504285 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0764-9931-4cc2-91b6-82dd80190a94 admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:51.505353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f0764-9931-4cc2-91b6-82dd80190a94 admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:51.532482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f0764-9931-4cc2-91b6-82dd80190a94 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:51.534104 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 164/327] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:51 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:51.539926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4252992-0b85-4505-a5f4-4f88a90cbc69 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:51.548652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4252992-0b85-4505-a5f4-4f88a90cbc69 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:51.552860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981513e9-9ddb-47e3-b397-a6774e58bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:51.553600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981513e9-9ddb-47e3-b397-a6774e58bee6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:51.553883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981513e9-9ddb-47e3-b397-a6774e58bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:51.554162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981513e9-9ddb-47e3-b397-a6774e58bee6 admin admin] PATH_INFO: `/v3/groups/3956e0a259c24bcdbd9f3221696817bb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:51.555265 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981513e9-9ddb-47e3-b397-a6774e58bee6 admin admin] RBAC: Authorizing `identity:get_group(group_id=3956e0a259c24bcdbd9f3221696817bb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:51.582431 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981513e9-9ddb-47e3-b397-a6774e58bee6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:51.583999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 164/328] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:51 2021] GET /identity/v3/groups/3956e0a259c24bcdbd9f3221696817bb => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:51.590211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f0764-9931-4cc2-91b6-82dd80190a94 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:51.599800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f0764-9931-4cc2-91b6-82dd80190a94 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:51.603654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69e5c1-51ed-457c-8b22-777f5c3a4394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:51.604229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69e5c1-51ed-457c-8b22-777f5c3a4394 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:51.604514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69e5c1-51ed-457c-8b22-777f5c3a4394 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:51.604791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69e5c1-51ed-457c-8b22-777f5c3a4394 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:51.605551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69e5c1-51ed-457c-8b22-777f5c3a4394 admin admin] RBAC: Adding query filter params (group.id=3956e0a259c24bcdbd9f3221696817bb, role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=833020c6e97d4c80bbe449fc92e597a4) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:51.605853 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69e5c1-51ed-457c-8b22-777f5c3a4394 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:51.632068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69e5c1-51ed-457c-8b22-777f5c3a4394 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:51.638612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 165/329] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:51 2021] GET /identity/v3/role_assignments?group.id=3956e0a259c24bcdbd9f3221696817bb&scope.project.id=833020c6e97d4c80bbe449fc92e597a4&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:53.650948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2162577-143d-49d5-b861-27c1dc7750c7 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:53.651475 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2162577-143d-49d5-b861-27c1dc7750c7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:53.651581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2162577-143d-49d5-b861-27c1dc7750c7 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:53.653185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 165/330] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:53.658572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4ea34-35dd-48f5-8cb3-45f91d332fa8 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:53.659009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4ea34-35dd-48f5-8cb3-45f91d332fa8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:53.659177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4ea34-35dd-48f5-8cb3-45f91d332fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:53.681467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-10c4ea34-35dd-48f5-8cb3-45f91d332fa8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:53.682596 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-10c4ea34-35dd-48f5-8cb3-45f91d332fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:53.689978 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 166/331] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:53.713653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2162577-143d-49d5-b861-27c1dc7750c7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:53.725536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2162577-143d-49d5-b861-27c1dc7750c7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:53.729339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015bb5-1663-4525-b46c-eaeac9213cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:53.730059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015bb5-1663-4525-b46c-eaeac9213cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:53.730349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015bb5-1663-4525-b46c-eaeac9213cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:53.730657 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015bb5-1663-4525-b46c-eaeac9213cf5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:53.741961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e015bb5-1663-4525-b46c-eaeac9213cf5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:53.748272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-9e015bb5-1663-4525-b46c-eaeac9213cf5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:55:53.749331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 166/332] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:55:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:53.756093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4ea34-35dd-48f5-8cb3-45f91d332fa8 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:53.764723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4ea34-35dd-48f5-8cb3-45f91d332fa8 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:53.769309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ecb7d-6e67-44dc-a2e5-e652783d1e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:53.769905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ecb7d-6e67-44dc-a2e5-e652783d1e0c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:53.770199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ecb7d-6e67-44dc-a2e5-e652783d1e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:53.770486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ecb7d-6e67-44dc-a2e5-e652783d1e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:53.771235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ecb7d-6e67-44dc-a2e5-e652783d1e0c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:53.771541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ecb7d-6e67-44dc-a2e5-e652783d1e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:53.796720 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ecb7d-6e67-44dc-a2e5-e652783d1e0c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:53.805829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 167/333] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:53.811788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015bb5-1663-4525-b46c-eaeac9213cf5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:53.822986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015bb5-1663-4525-b46c-eaeac9213cf5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:53.826928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400d79-6717-40f7-9633-a57a8cb60175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:53.827503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400d79-6717-40f7-9633-a57a8cb60175 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:53.827850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400d79-6717-40f7-9633-a57a8cb60175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:53.828696 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7400d79-6717-40f7-9633-a57a8cb60175 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:53.836483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400d79-6717-40f7-9633-a57a8cb60175 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:53.862650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7400d79-6717-40f7-9633-a57a8cb60175 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:53.871910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 167/334] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:53.879516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ecb7d-6e67-44dc-a2e5-e652783d1e0c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:53.888997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ecb7d-6e67-44dc-a2e5-e652783d1e0c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:53.893350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ade93-9f66-4016-8f82-e210fd3f1da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:53.894132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ade93-9f66-4016-8f82-e210fd3f1da5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:53.894427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ade93-9f66-4016-8f82-e210fd3f1da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:53.894753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ade93-9f66-4016-8f82-e210fd3f1da5 admin admin] PATH_INFO: `/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:53.895823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ade93-9f66-4016-8f82-e210fd3f1da5 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdb79eb1d18d4b408274e7d70cc19ee8)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:53.920962 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ade93-9f66-4016-8f82-e210fd3f1da5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:53.923262 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 168/335] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:53 2021] GET /identity/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8 => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:53.928731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400d79-6717-40f7-9633-a57a8cb60175 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:53.937912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7400d79-6717-40f7-9633-a57a8cb60175 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:53.941829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cc45e-77d5-427c-92cf-165d182ba21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:53.942600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cc45e-77d5-427c-92cf-165d182ba21f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:53.942915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cc45e-77d5-427c-92cf-165d182ba21f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:53.943197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cc45e-77d5-427c-92cf-165d182ba21f admin admin] PATH_INFO: `/v3/groups/657d4c9d885d4e229371a02240c7b370` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:53.947733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cc45e-77d5-427c-92cf-165d182ba21f admin admin] RBAC: Authorizing `identity:get_group(group_id=657d4c9d885d4e229371a02240c7b370)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:53.972776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cc45e-77d5-427c-92cf-165d182ba21f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:53.974279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 168/336] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:53 2021] GET /identity/v3/groups/657d4c9d885d4e229371a02240c7b370 => generated 229 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:53.979990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ade93-9f66-4016-8f82-e210fd3f1da5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:53.992919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ade93-9f66-4016-8f82-e210fd3f1da5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:53.996857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1dd5d-55cb-4135-b327-bf49a580de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:53.997435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1dd5d-55cb-4135-b327-bf49a580de64 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:53.997730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1dd5d-55cb-4135-b327-bf49a580de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:53.998017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1dd5d-55cb-4135-b327-bf49a580de64 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:53.998830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1dd5d-55cb-4135-b327-bf49a580de64 admin admin] RBAC: Adding query filter params (group.id=657d4c9d885d4e229371a02240c7b370, role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=cdb79eb1d18d4b408274e7d70cc19ee8) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:53.999136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1dd5d-55cb-4135-b327-bf49a580de64 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:54.025359 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1dd5d-55cb-4135-b327-bf49a580de64 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:54.031571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 169/337] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:53 2021] GET /identity/v3/role_assignments?group.id=657d4c9d885d4e229371a02240c7b370&scope.project.id=cdb79eb1d18d4b408274e7d70cc19ee8&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 260 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:55.973026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16c370-fe29-4511-ba44-2c9a1a7331e7 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:55.973552 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16c370-fe29-4511-ba44-2c9a1a7331e7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:55.973641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16c370-fe29-4511-ba44-2c9a1a7331e7 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:55.975280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 169/338] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:55.980536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd9721-fcbe-47f4-b735-339e98eb83cf None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:55.980920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd9721-fcbe-47f4-b735-339e98eb83cf None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:55.981114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd9721-fcbe-47f4-b735-339e98eb83cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:56.005963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-aecd9721-fcbe-47f4-b735-339e98eb83cf None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:56.007123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-aecd9721-fcbe-47f4-b735-339e98eb83cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:56.013931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 170/339] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:56.035716 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16c370-fe29-4511-ba44-2c9a1a7331e7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:56.047828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16c370-fe29-4511-ba44-2c9a1a7331e7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:56.051640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9d917-500e-4693-99b4-ab60a7af4ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:56.052357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9d917-500e-4693-99b4-ab60a7af4ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:56.052651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9d917-500e-4693-99b4-ab60a7af4ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:56.052940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9d917-500e-4693-99b4-ab60a7af4ff5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:56.064608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9d917-500e-4693-99b4-ab60a7af4ff5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:56.070908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-12b9d917-500e-4693-99b4-ab60a7af4ff5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:55:56.071980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 170/340] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:55:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:55:56.077585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd9721-fcbe-47f4-b735-339e98eb83cf None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:56.086260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd9721-fcbe-47f4-b735-339e98eb83cf None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:56.090054 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d9617-40dc-421c-93a5-0e29df6b451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:56.090677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d9617-40dc-421c-93a5-0e29df6b451e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:56.090968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d9617-40dc-421c-93a5-0e29df6b451e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:56.091247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d9617-40dc-421c-93a5-0e29df6b451e admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:56.091944 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d9617-40dc-421c-93a5-0e29df6b451e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:56.092244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d9617-40dc-421c-93a5-0e29df6b451e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:56.120226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d9617-40dc-421c-93a5-0e29df6b451e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:56.129177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 171/341] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:56.134482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9d917-500e-4693-99b4-ab60a7af4ff5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:56.144680 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9d917-500e-4693-99b4-ab60a7af4ff5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:56.148587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bda90-7b2a-46e7-946c-721c5f140a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:56.149359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bda90-7b2a-46e7-946c-721c5f140a55 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:56.149651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bda90-7b2a-46e7-946c-721c5f140a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:56.149939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bda90-7b2a-46e7-946c-721c5f140a55 admin admin] PATH_INFO: `/v3/groups/657d4c9d885d4e229371a02240c7b370` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:56.151012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bda90-7b2a-46e7-946c-721c5f140a55 admin admin] RBAC: Authorizing `identity:get_group(group_id=657d4c9d885d4e229371a02240c7b370)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:56.177697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bda90-7b2a-46e7-946c-721c5f140a55 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:56.179157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 171/342] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:56 2021] GET /identity/v3/groups/657d4c9d885d4e229371a02240c7b370 => generated 229 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:56.184366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d9617-40dc-421c-93a5-0e29df6b451e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:56.195575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d9617-40dc-421c-93a5-0e29df6b451e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:56.199630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9563-e6c3-4aea-91d7-364d69ff16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:56.200396 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9563-e6c3-4aea-91d7-364d69ff16e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:56.200681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9563-e6c3-4aea-91d7-364d69ff16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:56.200959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9563-e6c3-4aea-91d7-364d69ff16e7 admin admin] PATH_INFO: `/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:56.202111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a9563-e6c3-4aea-91d7-364d69ff16e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdb79eb1d18d4b408274e7d70cc19ee8)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:56.231245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a9563-e6c3-4aea-91d7-364d69ff16e7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:56.236984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 172/343] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:56 2021] GET /identity/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:56.242819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bda90-7b2a-46e7-946c-721c5f140a55 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:56.252906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bda90-7b2a-46e7-946c-721c5f140a55 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:56.256736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f6a6c-ac69-4d21-b396-87901f145d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:56.257576 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f6a6c-ac69-4d21-b396-87901f145d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:56.257867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f6a6c-ac69-4d21-b396-87901f145d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:56.258148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f6a6c-ac69-4d21-b396-87901f145d51 admin admin] PATH_INFO: `/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8/groups/657d4c9d885d4e229371a02240c7b370/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:56.259856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f6a6c-ac69-4d21-b396-87901f145d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb79eb1d18d4b408274e7d70cc19ee8, group_id=657d4c9d885d4e229371a02240c7b370, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:56.286599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f6a6c-ac69-4d21-b396-87901f145d51 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:56.299979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 172/344] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Oct 27 13:55:56 2021] PUT /identity/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8/groups/657d4c9d885d4e229371a02240c7b370/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:55:58.258855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e95b53-2181-4f96-98ae-bd732814bf4a None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:58.259425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e95b53-2181-4f96-98ae-bd732814bf4a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:58.259425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e95b53-2181-4f96-98ae-bd732814bf4a None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:58.261090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 173/345] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:55:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:55:58.266707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0153-171d-425b-9af0-cd0c5fb0dd2f None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:58.267113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0153-171d-425b-9af0-cd0c5fb0dd2f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:58.267287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c0153-171d-425b-9af0-cd0c5fb0dd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:58.289332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-152c0153-171d-425b-9af0-cd0c5fb0dd2f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:55:58.290455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-152c0153-171d-425b-9af0-cd0c5fb0dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:55:58.354559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 173/346] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:55:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:55:58.377817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e95b53-2181-4f96-98ae-bd732814bf4a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:58.389435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e95b53-2181-4f96-98ae-bd732814bf4a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:58.393473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1c33-0a44-4a14-952c-741b9a2b7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:58.394193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1c33-0a44-4a14-952c-741b9a2b7611 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:58.394478 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1c33-0a44-4a14-952c-741b9a2b7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:58.394822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1c33-0a44-4a14-952c-741b9a2b7611 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:58.406837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b1c33-0a44-4a14-952c-741b9a2b7611 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:55:58.413046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-798b1c33-0a44-4a14-952c-741b9a2b7611 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:55:58.414135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 174/347] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:55:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:55:58.419811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c0153-171d-425b-9af0-cd0c5fb0dd2f None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:58.428943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c0153-171d-425b-9af0-cd0c5fb0dd2f None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:58.432850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d58274-360c-4e0f-b0ae-370894dc705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:58.433441 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58274-360c-4e0f-b0ae-370894dc705f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:58.433730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58274-360c-4e0f-b0ae-370894dc705f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:58.434012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58274-360c-4e0f-b0ae-370894dc705f admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:58.434762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d58274-360c-4e0f-b0ae-370894dc705f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:58.435063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d58274-360c-4e0f-b0ae-370894dc705f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:58.460672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d58274-360c-4e0f-b0ae-370894dc705f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:58.469229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 174/348] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:55:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:58.474773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1c33-0a44-4a14-952c-741b9a2b7611 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:58.487341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1c33-0a44-4a14-952c-741b9a2b7611 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:58.491198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4166e-70cd-467f-b0f5-21c2780976e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:58.491768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4166e-70cd-467f-b0f5-21c2780976e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:58.492060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4166e-70cd-467f-b0f5-21c2780976e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:58.492346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4166e-70cd-467f-b0f5-21c2780976e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:58.500641 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4166e-70cd-467f-b0f5-21c2780976e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:58.525723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4166e-70cd-467f-b0f5-21c2780976e2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:58.534267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 175/349] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:55:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:55:58.540109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d58274-360c-4e0f-b0ae-370894dc705f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:58.549817 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d58274-360c-4e0f-b0ae-370894dc705f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:58.553643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e7071-bb98-44b6-a485-5563ecb47998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:58.554419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e7071-bb98-44b6-a485-5563ecb47998 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:58.554730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e7071-bb98-44b6-a485-5563ecb47998 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:58.555014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e7071-bb98-44b6-a485-5563ecb47998 admin admin] PATH_INFO: `/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:58.556074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e7071-bb98-44b6-a485-5563ecb47998 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdb79eb1d18d4b408274e7d70cc19ee8)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:58.581697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e7071-bb98-44b6-a485-5563ecb47998 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:58.583223 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 175/350] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:55:58 2021] GET /identity/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8 => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:55:58.589185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4166e-70cd-467f-b0f5-21c2780976e2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:58.597769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4166e-70cd-467f-b0f5-21c2780976e2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:58.601683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4a265-8131-49e6-8f2c-94edc9fad65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:58.602451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4a265-8131-49e6-8f2c-94edc9fad65e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:58.602783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4a265-8131-49e6-8f2c-94edc9fad65e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:58.603071 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4a265-8131-49e6-8f2c-94edc9fad65e admin admin] PATH_INFO: `/v3/groups/657d4c9d885d4e229371a02240c7b370` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:58.604121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4a265-8131-49e6-8f2c-94edc9fad65e admin admin] RBAC: Authorizing `identity:get_group(group_id=657d4c9d885d4e229371a02240c7b370)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:58.630489 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4a265-8131-49e6-8f2c-94edc9fad65e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:58.631969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 176/351] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Oct 27 13:55:58 2021] GET /identity/v3/groups/657d4c9d885d4e229371a02240c7b370 => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:55:58.637417 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e7071-bb98-44b6-a485-5563ecb47998 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:55:58.646781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e7071-bb98-44b6-a485-5563ecb47998 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:55:58.650732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a45d3f-98e1-4eaa-a4c6-88d2abd6742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:55:58.651309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45d3f-98e1-4eaa-a4c6-88d2abd6742a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:55:58.651599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45d3f-98e1-4eaa-a4c6-88d2abd6742a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:55:58.651880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45d3f-98e1-4eaa-a4c6-88d2abd6742a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:55:58.652647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a45d3f-98e1-4eaa-a4c6-88d2abd6742a admin admin] RBAC: Adding query filter params (group.id=657d4c9d885d4e229371a02240c7b370, role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=cdb79eb1d18d4b408274e7d70cc19ee8) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:55:58.652953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a45d3f-98e1-4eaa-a4c6-88d2abd6742a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:55:58.678414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a45d3f-98e1-4eaa-a4c6-88d2abd6742a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:55:58.684108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 176/352] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Oct 27 13:55:58 2021] GET /identity/v3/role_assignments?group.id=657d4c9d885d4e229371a02240c7b370&scope.project.id=cdb79eb1d18d4b408274e7d70cc19ee8&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:00.682534 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22729d-02e6-4cd9-a378-d3cac516a743 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:00.685277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22729d-02e6-4cd9-a378-d3cac516a743 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:00.685277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22729d-02e6-4cd9-a378-d3cac516a743 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:00.685277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 177/353] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:00.690404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb257d-5ef4-40c5-bf38-0c56170c22cf None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:00.690837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb257d-5ef4-40c5-bf38-0c56170c22cf None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:00.691000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb257d-5ef4-40c5-bf38-0c56170c22cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:00.713260 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-64fb257d-5ef4-40c5-bf38-0c56170c22cf None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:00.714382 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-64fb257d-5ef4-40c5-bf38-0c56170c22cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:00.721715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 177/354] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:00.745153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22729d-02e6-4cd9-a378-d3cac516a743 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:00.756554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22729d-02e6-4cd9-a378-d3cac516a743 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:00.760318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00b843-575c-42ec-b7df-6d8e25693c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:00.761023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00b843-575c-42ec-b7df-6d8e25693c6e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:00.761313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00b843-575c-42ec-b7df-6d8e25693c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:00.761594 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00b843-575c-42ec-b7df-6d8e25693c6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:00.773593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00b843-575c-42ec-b7df-6d8e25693c6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:00.799622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00b843-575c-42ec-b7df-6d8e25693c6e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:00.816619 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-df00b843-575c-42ec-b7df-6d8e25693c6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:00.817734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 178/355] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:00.823544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb257d-5ef4-40c5-bf38-0c56170c22cf None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:00.832298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb257d-5ef4-40c5-bf38-0c56170c22cf None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:00.836216 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d165d4-cf8b-44ac-96e9-49ce3b101b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:00.836819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d165d4-cf8b-44ac-96e9-49ce3b101b92 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:00.837100 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d165d4-cf8b-44ac-96e9-49ce3b101b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:00.837386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d165d4-cf8b-44ac-96e9-49ce3b101b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:00.838075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d165d4-cf8b-44ac-96e9-49ce3b101b92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:00.838376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d165d4-cf8b-44ac-96e9-49ce3b101b92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:00.865172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d165d4-cf8b-44ac-96e9-49ce3b101b92 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:00.878487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 178/356] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:00.884103 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00b843-575c-42ec-b7df-6d8e25693c6e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:00.893381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00b843-575c-42ec-b7df-6d8e25693c6e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:00.897142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a025aac-9708-4658-8077-5975132f16ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:00.897720 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025aac-9708-4658-8077-5975132f16ba admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:00.898006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025aac-9708-4658-8077-5975132f16ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:00.898284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025aac-9708-4658-8077-5975132f16ba admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:00.898974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a025aac-9708-4658-8077-5975132f16ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:00.924310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-7a025aac-9708-4658-8077-5975132f16ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:00.924310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:56:00.924310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:56:00.925494 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a025aac-9708-4658-8077-5975132f16ba admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:00.948690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 179/357] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:56:00 2021] POST /identity/v3/users => generated 246 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:56:02.946822 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf2ef-116e-4f97-8715-eccfedd054a9 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:02.947369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf2ef-116e-4f97-8715-eccfedd054a9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:02.947369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf2ef-116e-4f97-8715-eccfedd054a9 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:02.949060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 179/358] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:02.954981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45201a41-6e4c-4d0b-a297-6102f4595427 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:02.955383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45201a41-6e4c-4d0b-a297-6102f4595427 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:02.955550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45201a41-6e4c-4d0b-a297-6102f4595427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:02.977326 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-45201a41-6e4c-4d0b-a297-6102f4595427 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:02.978459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-45201a41-6e4c-4d0b-a297-6102f4595427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:02.985367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 180/359] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:03.007823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf2ef-116e-4f97-8715-eccfedd054a9 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.020444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf2ef-116e-4f97-8715-eccfedd054a9 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.024205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219ed70-de53-4199-8631-6eed909cc774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.024938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219ed70-de53-4199-8631-6eed909cc774 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.025225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219ed70-de53-4199-8631-6eed909cc774 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.025506 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219ed70-de53-4199-8631-6eed909cc774 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.036874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219ed70-de53-4199-8631-6eed909cc774 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:03.043233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-2219ed70-de53-4199-8631-6eed909cc774 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:56:03.044309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 180/360] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:03.050245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45201a41-6e4c-4d0b-a297-6102f4595427 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.058875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45201a41-6e4c-4d0b-a297-6102f4595427 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.063276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e100f5-b791-469d-bdda-bc29627c3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.063867 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e100f5-b791-469d-bdda-bc29627c3895 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.064157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e100f5-b791-469d-bdda-bc29627c3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.064440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e100f5-b791-469d-bdda-bc29627c3895 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.065152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e100f5-b791-469d-bdda-bc29627c3895 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:03.065449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e100f5-b791-469d-bdda-bc29627c3895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.090912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e100f5-b791-469d-bdda-bc29627c3895 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.099268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 181/361] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:03.104764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219ed70-de53-4199-8631-6eed909cc774 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.114712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219ed70-de53-4199-8631-6eed909cc774 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.118465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a5ea-61e1-4886-9e1b-d6381d103d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.119201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a5ea-61e1-4886-9e1b-d6381d103d99 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.119491 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a5ea-61e1-4886-9e1b-d6381d103d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.119773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a5ea-61e1-4886-9e1b-d6381d103d99 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.131397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27a5ea-61e1-4886-9e1b-d6381d103d99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.156994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27a5ea-61e1-4886-9e1b-d6381d103d99 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.174126 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-8c27a5ea-61e1-4886-9e1b-d6381d103d99 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:03.175211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 181/362] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:03.180843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e100f5-b791-469d-bdda-bc29627c3895 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.190598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e100f5-b791-469d-bdda-bc29627c3895 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.194496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.195107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.195399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.195684 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.196367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:03.196671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.221674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:03.221674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:56:03.221674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:56:03.222482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.235253 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 182/363] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:03.240880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a5ea-61e1-4886-9e1b-d6381d103d99 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.250527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a5ea-61e1-4886-9e1b-d6381d103d99 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.254340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b176a0-cfaa-4762-9c32-a304c5d7bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.255350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b176a0-cfaa-4762-9c32-a304c5d7bdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.255638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b176a0-cfaa-4762-9c32-a304c5d7bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.255916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b176a0-cfaa-4762-9c32-a304c5d7bdd1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.268976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b176a0-cfaa-4762-9c32-a304c5d7bdd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.294167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b176a0-cfaa-4762-9c32-a304c5d7bdd1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.313111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-40b176a0-cfaa-4762-9c32-a304c5d7bdd1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:56:03.314201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 182/364] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:03.319843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.329091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815a8e-91e9-4fdf-a1bf-df1c2f08a34b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.332884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.333470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.333758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.334040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.334858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:03.335157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.360146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:03.360146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:56:03.360146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:56:03.361522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.390961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 183/365] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:03.396481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b176a0-cfaa-4762-9c32-a304c5d7bdd1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.405615 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b176a0-cfaa-4762-9c32-a304c5d7bdd1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.409950 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7fe24-776f-491e-9187-4a6f398ca33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.410519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7fe24-776f-491e-9187-4a6f398ca33e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.410838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7fe24-776f-491e-9187-4a6f398ca33e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.411120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7fe24-776f-491e-9187-4a6f398ca33e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.418593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7fe24-776f-491e-9187-4a6f398ca33e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.443864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7fe24-776f-491e-9187-4a6f398ca33e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.452142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 183/366] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:56:03.458273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.467397 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c795b64-7b93-4b8d-9f73-648771ede9d9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.471913 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778b23b-23bf-42be-9adc-df705262e318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.472570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778b23b-23bf-42be-9adc-df705262e318 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.472861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778b23b-23bf-42be-9adc-df705262e318 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.473141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778b23b-23bf-42be-9adc-df705262e318 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.484505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778b23b-23bf-42be-9adc-df705262e318 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.509868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778b23b-23bf-42be-9adc-df705262e318 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.527119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-9778b23b-23bf-42be-9adc-df705262e318 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:03.528189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 184/367] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:03.533796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7fe24-776f-491e-9187-4a6f398ca33e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.543357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7fe24-776f-491e-9187-4a6f398ca33e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.547333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d375a09-e3fe-4db1-bac9-7a54879a4930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.547911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d375a09-e3fe-4db1-bac9-7a54879a4930 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.548197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d375a09-e3fe-4db1-bac9-7a54879a4930 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.548477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d375a09-e3fe-4db1-bac9-7a54879a4930 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.549148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d375a09-e3fe-4db1-bac9-7a54879a4930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:03.549446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d375a09-e3fe-4db1-bac9-7a54879a4930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.574084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d375a09-e3fe-4db1-bac9-7a54879a4930 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.587361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 184/368] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:03.592577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778b23b-23bf-42be-9adc-df705262e318 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.602278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778b23b-23bf-42be-9adc-df705262e318 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.606141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f59220-ab22-496c-8744-11d005878885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.606877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f59220-ab22-496c-8744-11d005878885 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.607165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f59220-ab22-496c-8744-11d005878885 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.607441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f59220-ab22-496c-8744-11d005878885 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.616652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f59220-ab22-496c-8744-11d005878885 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.643227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f59220-ab22-496c-8744-11d005878885 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.656574 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-43f59220-ab22-496c-8744-11d005878885 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:03.657619 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 185/369] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:03.662975 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d375a09-e3fe-4db1-bac9-7a54879a4930 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.672271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d375a09-e3fe-4db1-bac9-7a54879a4930 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.676151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26245a90-bcb9-4fe9-8e82-752c12933ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.676738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245a90-bcb9-4fe9-8e82-752c12933ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.677031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245a90-bcb9-4fe9-8e82-752c12933ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.677323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245a90-bcb9-4fe9-8e82-752c12933ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.678061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26245a90-bcb9-4fe9-8e82-752c12933ee3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:03.678369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26245a90-bcb9-4fe9-8e82-752c12933ee3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.704594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-26245a90-bcb9-4fe9-8e82-752c12933ee3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:03.704594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:56:03.704594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:56:03.705774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26245a90-bcb9-4fe9-8e82-752c12933ee3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.719782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 185/370] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:03.725589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f59220-ab22-496c-8744-11d005878885 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:03.734775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f59220-ab22-496c-8744-11d005878885 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:03.738850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e446b-40da-4f79-9eaf-d6b1b4454fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:03.739429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e446b-40da-4f79-9eaf-d6b1b4454fed admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:03.739717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e446b-40da-4f79-9eaf-d6b1b4454fed admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:03.739998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e446b-40da-4f79-9eaf-d6b1b4454fed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:03.740773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e446b-40da-4f79-9eaf-d6b1b4454fed admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=a523c35d222f464e9d4f78ae990e3a17) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:03.741076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e446b-40da-4f79-9eaf-d6b1b4454fed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:03.767539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e446b-40da-4f79-9eaf-d6b1b4454fed admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:03.772930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 186/371] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:56:03 2021] GET /identity/v3/role_assignments?user.id=a523c35d222f464e9d4f78ae990e3a17&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:05.692040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65634d0f-d5eb-49c5-bb58-b0b90045cf92 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:05.692619 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65634d0f-d5eb-49c5-bb58-b0b90045cf92 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:05.692619 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65634d0f-d5eb-49c5-bb58-b0b90045cf92 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:05.694262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 186/372] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:05.699495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d65b84-882a-4071-84e0-2525b8f52c0d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:05.699932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d65b84-882a-4071-84e0-2525b8f52c0d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:05.700068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d65b84-882a-4071-84e0-2525b8f52c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:05.722564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e8d65b84-882a-4071-84e0-2525b8f52c0d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:05.723806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e8d65b84-882a-4071-84e0-2525b8f52c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:05.730317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 187/373] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:05.752572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65634d0f-d5eb-49c5-bb58-b0b90045cf92 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:05.763902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65634d0f-d5eb-49c5-bb58-b0b90045cf92 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:05.767753 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bbecd-5c91-4863-9af9-b4653ea77e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:05.768467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bbecd-5c91-4863-9af9-b4653ea77e25 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:05.768756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bbecd-5c91-4863-9af9-b4653ea77e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:05.769038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bbecd-5c91-4863-9af9-b4653ea77e25 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:05.780020 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bbecd-5c91-4863-9af9-b4653ea77e25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:05.786409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-704bbecd-5c91-4863-9af9-b4653ea77e25 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:56:05.787562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 187/374] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:56:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:05.793210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d65b84-882a-4071-84e0-2525b8f52c0d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:05.802215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d65b84-882a-4071-84e0-2525b8f52c0d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:05.805978 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91464c0-c9a6-4e6a-8184-9ae6f40aeb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:05.806562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91464c0-c9a6-4e6a-8184-9ae6f40aeb12 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:05.806876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91464c0-c9a6-4e6a-8184-9ae6f40aeb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:05.807159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91464c0-c9a6-4e6a-8184-9ae6f40aeb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:05.807856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91464c0-c9a6-4e6a-8184-9ae6f40aeb12 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:05.808153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91464c0-c9a6-4e6a-8184-9ae6f40aeb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:05.833949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91464c0-c9a6-4e6a-8184-9ae6f40aeb12 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:05.843195 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 188/375] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:56:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:05.848893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bbecd-5c91-4863-9af9-b4653ea77e25 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:05.859765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bbecd-5c91-4863-9af9-b4653ea77e25 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:05.863898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf12d-2fcb-4284-a35b-6a3741d987c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:05.864613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf12d-2fcb-4284-a35b-6a3741d987c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:05.864904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf12d-2fcb-4284-a35b-6a3741d987c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:05.865188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf12d-2fcb-4284-a35b-6a3741d987c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:05.877434 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bf12d-2fcb-4284-a35b-6a3741d987c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:05.902717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bf12d-2fcb-4284-a35b-6a3741d987c7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:05.920986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-d13bf12d-2fcb-4284-a35b-6a3741d987c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:05.922894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 188/376] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:05.928465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91464c0-c9a6-4e6a-8184-9ae6f40aeb12 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:05.937818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91464c0-c9a6-4e6a-8184-9ae6f40aeb12 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:05.941693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74eb2d-9306-4ada-a81e-08e71277dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:05.942325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74eb2d-9306-4ada-a81e-08e71277dc94 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:05.942573 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74eb2d-9306-4ada-a81e-08e71277dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:05.942900 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74eb2d-9306-4ada-a81e-08e71277dc94 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:05.943583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74eb2d-9306-4ada-a81e-08e71277dc94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:05.943885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74eb2d-9306-4ada-a81e-08e71277dc94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:05.969654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74eb2d-9306-4ada-a81e-08e71277dc94 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:05.982906 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 189/377] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:05.989010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf12d-2fcb-4284-a35b-6a3741d987c7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:05.998158 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf12d-2fcb-4284-a35b-6a3741d987c7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:06.002014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62518f-73e7-425b-a154-87adc11c8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:06.002750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62518f-73e7-425b-a154-87adc11c8a5d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:06.003038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62518f-73e7-425b-a154-87adc11c8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:06.003318 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62518f-73e7-425b-a154-87adc11c8a5d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:06.016070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62518f-73e7-425b-a154-87adc11c8a5d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:06.041989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62518f-73e7-425b-a154-87adc11c8a5d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:06.060059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-1a62518f-73e7-425b-a154-87adc11c8a5d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:56:06.061140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 189/378] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Oct 27 13:56:05 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:06.066778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74eb2d-9306-4ada-a81e-08e71277dc94 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:06.076203 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74eb2d-9306-4ada-a81e-08e71277dc94 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:06.080585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890a46c-e55b-4340-9781-404138b77fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:06.081181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890a46c-e55b-4340-9781-404138b77fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:06.081476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890a46c-e55b-4340-9781-404138b77fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:06.081763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890a46c-e55b-4340-9781-404138b77fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:06.082554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890a46c-e55b-4340-9781-404138b77fa0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:06.082893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890a46c-e55b-4340-9781-404138b77fa0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:06.108646 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890a46c-e55b-4340-9781-404138b77fa0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:06.217968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 190/379] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Oct 27 13:56:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:06.223862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62518f-73e7-425b-a154-87adc11c8a5d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:06.232995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62518f-73e7-425b-a154-87adc11c8a5d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:06.237961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331b00-4e09-4b18-b493-cca0cb2544d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:06.238710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331b00-4e09-4b18-b493-cca0cb2544d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:06.238997 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331b00-4e09-4b18-b493-cca0cb2544d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:06.239277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331b00-4e09-4b18-b493-cca0cb2544d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:06.252396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56331b00-4e09-4b18-b493-cca0cb2544d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:06.277816 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56331b00-4e09-4b18-b493-cca0cb2544d4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:06.294808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-56331b00-4e09-4b18-b493-cca0cb2544d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:06.295858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 190/380] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:06.301477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890a46c-e55b-4340-9781-404138b77fa0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:06.310785 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890a46c-e55b-4340-9781-404138b77fa0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:06.314673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1809c51-6981-4589-9fc2-0c2de831889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:06.315258 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1809c51-6981-4589-9fc2-0c2de831889c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:06.315550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1809c51-6981-4589-9fc2-0c2de831889c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:06.315835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1809c51-6981-4589-9fc2-0c2de831889c admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:06.316515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1809c51-6981-4589-9fc2-0c2de831889c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:06.316813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1809c51-6981-4589-9fc2-0c2de831889c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:06.342400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1809c51-6981-4589-9fc2-0c2de831889c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:06.355824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 191/381] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:06.361666 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331b00-4e09-4b18-b493-cca0cb2544d4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:06.370910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331b00-4e09-4b18-b493-cca0cb2544d4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:06.375062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2f3ce-6f4c-4678-8ba6-d71b1aec1d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:06.375781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2f3ce-6f4c-4678-8ba6-d71b1aec1d09 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:06.376076 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2f3ce-6f4c-4678-8ba6-d71b1aec1d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:06.376361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2f3ce-6f4c-4678-8ba6-d71b1aec1d09 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:06.460133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2f3ce-6f4c-4678-8ba6-d71b1aec1d09 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:06.486274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2f3ce-6f4c-4678-8ba6-d71b1aec1d09 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:06.499990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-70b2f3ce-6f4c-4678-8ba6-d71b1aec1d09 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:06.501079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 191/382] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:56:06.506719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1809c51-6981-4589-9fc2-0c2de831889c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:06.516577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1809c51-6981-4589-9fc2-0c2de831889c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:06.520431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374d8b4-28e4-49cb-a2a9-1adda93aec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:06.521011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374d8b4-28e4-49cb-a2a9-1adda93aec5f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:06.521298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374d8b4-28e4-49cb-a2a9-1adda93aec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:06.521577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374d8b4-28e4-49cb-a2a9-1adda93aec5f admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:06.522316 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374d8b4-28e4-49cb-a2a9-1adda93aec5f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:06.522668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374d8b4-28e4-49cb-a2a9-1adda93aec5f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:06.547447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-7374d8b4-28e4-49cb-a2a9-1adda93aec5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:06.547447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:56:06.547447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:56:06.548568 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374d8b4-28e4-49cb-a2a9-1adda93aec5f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:06.561400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 192/383] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:06.566934 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2f3ce-6f4c-4678-8ba6-d71b1aec1d09 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:06.576886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2f3ce-6f4c-4678-8ba6-d71b1aec1d09 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:06.581377 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ba2d9-685f-42b3-b5c6-8371098bc726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:06.582178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba2d9-685f-42b3-b5c6-8371098bc726 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:06.582467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba2d9-685f-42b3-b5c6-8371098bc726 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:06.582779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba2d9-685f-42b3-b5c6-8371098bc726 admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/a523c35d222f464e9d4f78ae990e3a17/roles/18aaf45888374560a4c11e1912d42c97` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:06.602282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ba2d9-685f-42b3-b5c6-8371098bc726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=a523c35d222f464e9d4f78ae990e3a17, role_id=18aaf45888374560a4c11e1912d42c97)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:06.628954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ba2d9-685f-42b3-b5c6-8371098bc726 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:06.640747 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 192/384] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:56:06 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/a523c35d222f464e9d4f78ae990e3a17/roles/18aaf45888374560a4c11e1912d42c97 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:56:08.598813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382da7dc-fc37-4fda-8b41-dcf8c2308a00 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:08.600683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382da7dc-fc37-4fda-8b41-dcf8c2308a00 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:08.600683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382da7dc-fc37-4fda-8b41-dcf8c2308a00 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:08.601237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 193/385] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:08.606561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ff09-4fd7-4645-9ae1-131645971997 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:08.607033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ff09-4fd7-4645-9ae1-131645971997 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:08.607164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61ff09-4fd7-4645-9ae1-131645971997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:08.629825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6c61ff09-4fd7-4645-9ae1-131645971997 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:08.631002 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6c61ff09-4fd7-4645-9ae1-131645971997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:08.693541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 193/386] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:08.716045 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382da7dc-fc37-4fda-8b41-dcf8c2308a00 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:08.728150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382da7dc-fc37-4fda-8b41-dcf8c2308a00 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:08.731949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7a96-4202-4b20-b7a7-d603ca714e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:08.732667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7a96-4202-4b20-b7a7-d603ca714e3d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:08.732959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7a96-4202-4b20-b7a7-d603ca714e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:08.733246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7a96-4202-4b20-b7a7-d603ca714e3d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:08.744800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f7a96-4202-4b20-b7a7-d603ca714e3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:08.751446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-3f0f7a96-4202-4b20-b7a7-d603ca714e3d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:56:08.752521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 194/387] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:56:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:08.757919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ff09-4fd7-4645-9ae1-131645971997 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:08.766863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61ff09-4fd7-4645-9ae1-131645971997 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:08.770791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c5fc0-e663-4d3c-929c-09d7dea87633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:08.771386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c5fc0-e663-4d3c-929c-09d7dea87633 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:08.771688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c5fc0-e663-4d3c-929c-09d7dea87633 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:08.771959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c5fc0-e663-4d3c-929c-09d7dea87633 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:08.772668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c5fc0-e663-4d3c-929c-09d7dea87633 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:08.772964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c5fc0-e663-4d3c-929c-09d7dea87633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:08.798519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c5fc0-e663-4d3c-929c-09d7dea87633 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:08.807238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 194/388] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:56:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:08.812992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7a96-4202-4b20-b7a7-d603ca714e3d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:08.823032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7a96-4202-4b20-b7a7-d603ca714e3d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:08.827011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed177a1-f3c2-45e1-9550-70ee6cbb2d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:08.828367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed177a1-f3c2-45e1-9550-70ee6cbb2d0a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:08.828687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed177a1-f3c2-45e1-9550-70ee6cbb2d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:08.828973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed177a1-f3c2-45e1-9550-70ee6cbb2d0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:08.840288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed177a1-f3c2-45e1-9550-70ee6cbb2d0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:08.867076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed177a1-f3c2-45e1-9550-70ee6cbb2d0a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:08.886462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-5ed177a1-f3c2-45e1-9550-70ee6cbb2d0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:08.887591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 195/389] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:08.893912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c5fc0-e663-4d3c-929c-09d7dea87633 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:08.903057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c5fc0-e663-4d3c-929c-09d7dea87633 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:08.906993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c3172-650b-4dcb-98e5-8f500f3d1aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:08.907569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3172-650b-4dcb-98e5-8f500f3d1aed admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:08.907854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3172-650b-4dcb-98e5-8f500f3d1aed admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:08.908133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3172-650b-4dcb-98e5-8f500f3d1aed admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:08.908804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c3172-650b-4dcb-98e5-8f500f3d1aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:08.909100 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c3172-650b-4dcb-98e5-8f500f3d1aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:08.934064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c3172-650b-4dcb-98e5-8f500f3d1aed admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:08.947245 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 195/390] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:08.953664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed177a1-f3c2-45e1-9550-70ee6cbb2d0a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:08.962977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed177a1-f3c2-45e1-9550-70ee6cbb2d0a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:08.966941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a39b8-74ab-4980-97e4-7a3c6712f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:08.967653 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a39b8-74ab-4980-97e4-7a3c6712f436 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:08.967947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a39b8-74ab-4980-97e4-7a3c6712f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:08.968417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a39b8-74ab-4980-97e4-7a3c6712f436 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:08.981071 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a39b8-74ab-4980-97e4-7a3c6712f436 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:09.007933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a39b8-74ab-4980-97e4-7a3c6712f436 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:09.027035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-e72a39b8-74ab-4980-97e4-7a3c6712f436 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:56:09.028134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 196/391] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Oct 27 13:56:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:09.033713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c3172-650b-4dcb-98e5-8f500f3d1aed admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:09.042868 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c3172-650b-4dcb-98e5-8f500f3d1aed admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:09.047002 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:09.047608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:09.047901 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:09.048181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:09.048976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:09.049282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:09.073960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:09.073960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:56:09.073960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:56:09.075104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:09.104436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 196/392] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Oct 27 13:56:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:09.110604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a39b8-74ab-4980-97e4-7a3c6712f436 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:09.120373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a39b8-74ab-4980-97e4-7a3c6712f436 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:09.124634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96b633-cbec-4267-8746-e0ccdfe11d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:09.125217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96b633-cbec-4267-8746-e0ccdfe11d14 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:09.125512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96b633-cbec-4267-8746-e0ccdfe11d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:09.125792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96b633-cbec-4267-8746-e0ccdfe11d14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:09.133349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96b633-cbec-4267-8746-e0ccdfe11d14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:09.159607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96b633-cbec-4267-8746-e0ccdfe11d14 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:09.168122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 197/393] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:56:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:56:09.173708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:09.182995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704481e-0a60-41b0-a5d9-480108746cdd admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:09.187406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651a8a8-d2d0-4022-9644-1cd287cd7aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:09.188115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651a8a8-d2d0-4022-9644-1cd287cd7aca admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:09.188410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651a8a8-d2d0-4022-9644-1cd287cd7aca admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:09.188689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651a8a8-d2d0-4022-9644-1cd287cd7aca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:09.199916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651a8a8-d2d0-4022-9644-1cd287cd7aca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:09.225515 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651a8a8-d2d0-4022-9644-1cd287cd7aca admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:09.242186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-5651a8a8-d2d0-4022-9644-1cd287cd7aca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:09.243273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 197/394] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:09.248628 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96b633-cbec-4267-8746-e0ccdfe11d14 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:09.257650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96b633-cbec-4267-8746-e0ccdfe11d14 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:09.261723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7e003-e6f4-406f-acfe-8982eb00eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:09.262309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e003-e6f4-406f-acfe-8982eb00eec3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:09.262603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e003-e6f4-406f-acfe-8982eb00eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:09.262922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e003-e6f4-406f-acfe-8982eb00eec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:09.263600 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7e003-e6f4-406f-acfe-8982eb00eec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:09.263904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7e003-e6f4-406f-acfe-8982eb00eec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:09.290187 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7e003-e6f4-406f-acfe-8982eb00eec3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:09.304580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 198/395] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:09.310060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651a8a8-d2d0-4022-9644-1cd287cd7aca admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:09.320053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651a8a8-d2d0-4022-9644-1cd287cd7aca admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:09.323895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34c38c-3dfe-4238-9d2d-cbca63a489c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:09.324598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c38c-3dfe-4238-9d2d-cbca63a489c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:09.324885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c38c-3dfe-4238-9d2d-cbca63a489c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:09.325168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c38c-3dfe-4238-9d2d-cbca63a489c2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:09.333835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34c38c-3dfe-4238-9d2d-cbca63a489c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:09.359480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34c38c-3dfe-4238-9d2d-cbca63a489c2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:09.372905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-1b34c38c-3dfe-4238-9d2d-cbca63a489c2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:09.373902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 198/396] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:56:09.380059 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7e003-e6f4-406f-acfe-8982eb00eec3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:09.389406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7e003-e6f4-406f-acfe-8982eb00eec3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:09.393384 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55347e87-3879-4194-8d5c-f84bd3a61e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:09.393968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55347e87-3879-4194-8d5c-f84bd3a61e36 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:09.394269 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55347e87-3879-4194-8d5c-f84bd3a61e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:09.394556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55347e87-3879-4194-8d5c-f84bd3a61e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:09.395334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55347e87-3879-4194-8d5c-f84bd3a61e36 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:09.395634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55347e87-3879-4194-8d5c-f84bd3a61e36 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:09.421707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55347e87-3879-4194-8d5c-f84bd3a61e36 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:09.434864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 199/397] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:09.441136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34c38c-3dfe-4238-9d2d-cbca63a489c2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:09.450406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34c38c-3dfe-4238-9d2d-cbca63a489c2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:09.454591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b98a48-2a06-493b-a1a7-efc294c913a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:09.455200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b98a48-2a06-493b-a1a7-efc294c913a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:09.455492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b98a48-2a06-493b-a1a7-efc294c913a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:09.455776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b98a48-2a06-493b-a1a7-efc294c913a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:09.456554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b98a48-2a06-493b-a1a7-efc294c913a0 admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=a523c35d222f464e9d4f78ae990e3a17) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:09.456863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b98a48-2a06-493b-a1a7-efc294c913a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:09.482004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b98a48-2a06-493b-a1a7-efc294c913a0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:09.488614 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 199/398] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:56:09 2021] GET /identity/v3/role_assignments?user.id=a523c35d222f464e9d4f78ae990e3a17&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:11.496933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8076-20fa-4e6d-a9a1-bb4cda249ffc None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:11.497454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8076-20fa-4e6d-a9a1-bb4cda249ffc None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:11.497565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8076-20fa-4e6d-a9a1-bb4cda249ffc None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:11.500115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 200/399] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:11.505367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa60b-d920-4981-b5d9-a2677cbbf97c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:11.505780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa60b-d920-4981-b5d9-a2677cbbf97c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:11.505932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa60b-d920-4981-b5d9-a2677cbbf97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:11.528508 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0f4aa60b-d920-4981-b5d9-a2677cbbf97c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:11.529616 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0f4aa60b-d920-4981-b5d9-a2677cbbf97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:11.536106 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 200/400] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:11.557656 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8076-20fa-4e6d-a9a1-bb4cda249ffc None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:11.569677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8076-20fa-4e6d-a9a1-bb4cda249ffc None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:11.573451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db74f8-f14a-4280-bc65-bcecb2fe79e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:11.574155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db74f8-f14a-4280-bc65-bcecb2fe79e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:11.574445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db74f8-f14a-4280-bc65-bcecb2fe79e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:11.574759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db74f8-f14a-4280-bc65-bcecb2fe79e7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:11.585828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db74f8-f14a-4280-bc65-bcecb2fe79e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:11.592120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-55db74f8-f14a-4280-bc65-bcecb2fe79e7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:56:11.593182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 201/401] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:56:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:11.598702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aa60b-d920-4981-b5d9-a2677cbbf97c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:11.607232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aa60b-d920-4981-b5d9-a2677cbbf97c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:11.612057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd47c39-20df-4519-b009-4dff6ee6bac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:11.612643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd47c39-20df-4519-b009-4dff6ee6bac2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:11.612937 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd47c39-20df-4519-b009-4dff6ee6bac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:11.613340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd47c39-20df-4519-b009-4dff6ee6bac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:11.614027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd47c39-20df-4519-b009-4dff6ee6bac2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:11.614289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd47c39-20df-4519-b009-4dff6ee6bac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:11.640286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd47c39-20df-4519-b009-4dff6ee6bac2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:11.653218 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 201/402] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:56:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:11.658933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db74f8-f14a-4280-bc65-bcecb2fe79e7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:11.671668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db74f8-f14a-4280-bc65-bcecb2fe79e7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:11.675713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ae2c7-45b6-46c8-9389-08e73d12e3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:11.676433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae2c7-45b6-46c8-9389-08e73d12e3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:11.676724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae2c7-45b6-46c8-9389-08e73d12e3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:11.677007 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae2c7-45b6-46c8-9389-08e73d12e3b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:11.688868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ae2c7-45b6-46c8-9389-08e73d12e3b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:11.714006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ae2c7-45b6-46c8-9389-08e73d12e3b5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:11.731611 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-fd9ae2c7-45b6-46c8-9389-08e73d12e3b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:11.732694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 202/403] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:11.738941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd47c39-20df-4519-b009-4dff6ee6bac2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:11.748111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd47c39-20df-4519-b009-4dff6ee6bac2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:11.752570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2484f-713d-4772-a434-5bee6dcd5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:11.753150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2484f-713d-4772-a434-5bee6dcd5ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:11.753437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2484f-713d-4772-a434-5bee6dcd5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:11.753719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2484f-713d-4772-a434-5bee6dcd5ae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:11.754394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2484f-713d-4772-a434-5bee6dcd5ae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:11.754721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2484f-713d-4772-a434-5bee6dcd5ae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:11.779438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2484f-713d-4772-a434-5bee6dcd5ae8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:11.793339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 202/404] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:11.799321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ae2c7-45b6-46c8-9389-08e73d12e3b5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:11.808764 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ae2c7-45b6-46c8-9389-08e73d12e3b5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:11.813351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899975a-3388-43d7-a274-ff4d03982570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:11.814073 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899975a-3388-43d7-a274-ff4d03982570 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:11.814365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899975a-3388-43d7-a274-ff4d03982570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:11.814678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899975a-3388-43d7-a274-ff4d03982570 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:11.828062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899975a-3388-43d7-a274-ff4d03982570 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:11.853997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899975a-3388-43d7-a274-ff4d03982570 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:11.873068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-e899975a-3388-43d7-a274-ff4d03982570 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:56:11.874812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 203/405] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Oct 27 13:56:11 2021] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:11.880553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2484f-713d-4772-a434-5bee6dcd5ae8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:11.889741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2484f-713d-4772-a434-5bee6dcd5ae8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:11.893868 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709393ec-f02e-42cb-a559-fcd00b9b9648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:11.894458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709393ec-f02e-42cb-a559-fcd00b9b9648 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:11.894780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709393ec-f02e-42cb-a559-fcd00b9b9648 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:11.895065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709393ec-f02e-42cb-a559-fcd00b9b9648 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:11.895845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709393ec-f02e-42cb-a559-fcd00b9b9648 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:11.896149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709393ec-f02e-42cb-a559-fcd00b9b9648 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:11.923027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709393ec-f02e-42cb-a559-fcd00b9b9648 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:11.951886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 203/406] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Oct 27 13:56:11 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:11.957609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899975a-3388-43d7-a274-ff4d03982570 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:11.966956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899975a-3388-43d7-a274-ff4d03982570 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:11.971593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12029035-8298-4566-a1c3-fe4af0a14878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:11.972166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029035-8298-4566-a1c3-fe4af0a14878 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:11.972464 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029035-8298-4566-a1c3-fe4af0a14878 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:11.972747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029035-8298-4566-a1c3-fe4af0a14878 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:11.980422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12029035-8298-4566-a1c3-fe4af0a14878 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:12.006599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12029035-8298-4566-a1c3-fe4af0a14878 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:12.015903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 204/407] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:56:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:56:12.021379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709393ec-f02e-42cb-a559-fcd00b9b9648 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:12.032482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709393ec-f02e-42cb-a559-fcd00b9b9648 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:12.037690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dfe38-11ec-4a28-a50f-33ce6d877dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:12.038415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dfe38-11ec-4a28-a50f-33ce6d877dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:12.038740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dfe38-11ec-4a28-a50f-33ce6d877dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:12.039031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dfe38-11ec-4a28-a50f-33ce6d877dc0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:12.051412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dfe38-11ec-4a28-a50f-33ce6d877dc0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:12.077133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dfe38-11ec-4a28-a50f-33ce6d877dc0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:12.094786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-638dfe38-11ec-4a28-a50f-33ce6d877dc0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:12.095888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 204/408] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:12.101368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12029035-8298-4566-a1c3-fe4af0a14878 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:12.110605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12029035-8298-4566-a1c3-fe4af0a14878 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:12.114973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f74e2-3e11-485f-a4f9-3dd3b4341c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:12.115591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f74e2-3e11-485f-a4f9-3dd3b4341c7e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:12.116032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f74e2-3e11-485f-a4f9-3dd3b4341c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:12.116315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f74e2-3e11-485f-a4f9-3dd3b4341c7e admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:12.116995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f74e2-3e11-485f-a4f9-3dd3b4341c7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:12.117297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f74e2-3e11-485f-a4f9-3dd3b4341c7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:12.142272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f74e2-3e11-485f-a4f9-3dd3b4341c7e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:12.155795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 205/409] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:12.161857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dfe38-11ec-4a28-a50f-33ce6d877dc0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:12.171732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dfe38-11ec-4a28-a50f-33ce6d877dc0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:12.175632 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb20e3-9749-415b-b20f-092e52810bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:12.176349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb20e3-9749-415b-b20f-092e52810bae admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:12.176636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb20e3-9749-415b-b20f-092e52810bae admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:12.176919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb20e3-9749-415b-b20f-092e52810bae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:12.185722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb20e3-9749-415b-b20f-092e52810bae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:12.213240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb20e3-9749-415b-b20f-092e52810bae admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:12.227575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-b1fb20e3-9749-415b-b20f-092e52810bae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:12.228733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 205/410] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:12.234855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f74e2-3e11-485f-a4f9-3dd3b4341c7e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:12.244461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f74e2-3e11-485f-a4f9-3dd3b4341c7e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:12.248449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e8140-4121-4be8-ae6f-96a229eecff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:12.249044 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8140-4121-4be8-ae6f-96a229eecff0 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:12.249499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8140-4121-4be8-ae6f-96a229eecff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:12.249899 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8140-4121-4be8-ae6f-96a229eecff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:12.250665 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e8140-4121-4be8-ae6f-96a229eecff0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:12.250979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e8140-4121-4be8-ae6f-96a229eecff0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:12.277075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e8140-4121-4be8-ae6f-96a229eecff0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:12.291732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 206/411] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:12.297455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb20e3-9749-415b-b20f-092e52810bae admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:12.306648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb20e3-9749-415b-b20f-092e52810bae admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:12.310570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57820799-26e9-4299-b0ee-380ca987623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:12.311216 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820799-26e9-4299-b0ee-380ca987623d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:12.311571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820799-26e9-4299-b0ee-380ca987623d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:12.311927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820799-26e9-4299-b0ee-380ca987623d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:12.312747 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57820799-26e9-4299-b0ee-380ca987623d admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=a523c35d222f464e9d4f78ae990e3a17) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:12.313097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57820799-26e9-4299-b0ee-380ca987623d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:12.338912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57820799-26e9-4299-b0ee-380ca987623d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:12.344381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 206/412] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:56:12 2021] GET /identity/v3/role_assignments?user.id=a523c35d222f464e9d4f78ae990e3a17&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:14.310819 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd273c1-6e3e-4d0c-8a42-83e0eb80e960 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.311320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd273c1-6e3e-4d0c-8a42-83e0eb80e960 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.311320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd273c1-6e3e-4d0c-8a42-83e0eb80e960 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.313223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 207/413] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:14.318517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a99c-d62e-4256-8c66-e558cb566ede None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.318987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a99c-d62e-4256-8c66-e558cb566ede None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.319115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a99c-d62e-4256-8c66-e558cb566ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.341188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0f56a99c-d62e-4256-8c66-e558cb566ede None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:14.342287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0f56a99c-d62e-4256-8c66-e558cb566ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:14.349587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 207/414] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:14.371170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd273c1-6e3e-4d0c-8a42-83e0eb80e960 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.382801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd273c1-6e3e-4d0c-8a42-83e0eb80e960 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.386558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524bbfe-26d9-487f-a174-fd78a9563a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.387289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524bbfe-26d9-487f-a174-fd78a9563a05 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.387575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524bbfe-26d9-487f-a174-fd78a9563a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.387855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524bbfe-26d9-487f-a174-fd78a9563a05 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.399066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524bbfe-26d9-487f-a174-fd78a9563a05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:14.405165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-1524bbfe-26d9-487f-a174-fd78a9563a05 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:56:14.406868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 208/415] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:14.412639 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a99c-d62e-4256-8c66-e558cb566ede None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.421253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a99c-d62e-4256-8c66-e558cb566ede None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.425903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6d8a-cb66-431d-b447-005b3e59fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.426498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6d8a-cb66-431d-b447-005b3e59fe0a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.426820 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6d8a-cb66-431d-b447-005b3e59fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.427140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6d8a-cb66-431d-b447-005b3e59fe0a admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.427856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed6d8a-cb66-431d-b447-005b3e59fe0a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:14.428159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed6d8a-cb66-431d-b447-005b3e59fe0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:14.453264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed6d8a-cb66-431d-b447-005b3e59fe0a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:14.462259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 208/416] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:14.468459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524bbfe-26d9-487f-a174-fd78a9563a05 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.478258 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524bbfe-26d9-487f-a174-fd78a9563a05 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.482181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91f61f-25b7-4513-824a-92269561a69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.482927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91f61f-25b7-4513-824a-92269561a69a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.483221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91f61f-25b7-4513-824a-92269561a69a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.484124 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91f61f-25b7-4513-824a-92269561a69a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.495596 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91f61f-25b7-4513-824a-92269561a69a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:14.521273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91f61f-25b7-4513-824a-92269561a69a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:14.539153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-fd91f61f-25b7-4513-824a-92269561a69a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:14.540210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 209/417] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:14.545646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6d8a-cb66-431d-b447-005b3e59fe0a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.554881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6d8a-cb66-431d-b447-005b3e59fe0a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.558703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2561b-0a9f-4e61-b5b4-fae257324bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.559279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2561b-0a9f-4e61-b5b4-fae257324bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.559564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2561b-0a9f-4e61-b5b4-fae257324bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.559845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2561b-0a9f-4e61-b5b4-fae257324bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.560516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2561b-0a9f-4e61-b5b4-fae257324bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:14.560815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2561b-0a9f-4e61-b5b4-fae257324bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:14.586017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2561b-0a9f-4e61-b5b4-fae257324bd7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:14.599147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 209/418] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:14.604368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91f61f-25b7-4513-824a-92269561a69a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.613768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91f61f-25b7-4513-824a-92269561a69a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.617644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848bd78-5d10-4f2e-af72-ad19d84c4443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.618338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848bd78-5d10-4f2e-af72-ad19d84c4443 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.618634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848bd78-5d10-4f2e-af72-ad19d84c4443 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.618951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848bd78-5d10-4f2e-af72-ad19d84c4443 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.631487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848bd78-5d10-4f2e-af72-ad19d84c4443 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:14.657986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848bd78-5d10-4f2e-af72-ad19d84c4443 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:14.675432 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-3848bd78-5d10-4f2e-af72-ad19d84c4443 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:56:14.676512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 210/419] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:14.682003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2561b-0a9f-4e61-b5b4-fae257324bd7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.691316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2561b-0a9f-4e61-b5b4-fae257324bd7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.695164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e1666-ad78-4e50-955a-7157b142fbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.695751 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1666-ad78-4e50-955a-7157b142fbfb admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.696041 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1666-ad78-4e50-955a-7157b142fbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.696324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1666-ad78-4e50-955a-7157b142fbfb admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.697109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e1666-ad78-4e50-955a-7157b142fbfb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:14.697410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e1666-ad78-4e50-955a-7157b142fbfb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:14.723666 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e1666-ad78-4e50-955a-7157b142fbfb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:14.751997 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 210/420] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:14.757331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848bd78-5d10-4f2e-af72-ad19d84c4443 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.767177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848bd78-5d10-4f2e-af72-ad19d84c4443 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.771011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97effce9-c820-4f91-9d85-143f1dd7e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.771747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97effce9-c820-4f91-9d85-143f1dd7e75a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.772040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97effce9-c820-4f91-9d85-143f1dd7e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.772328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97effce9-c820-4f91-9d85-143f1dd7e75a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.785094 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97effce9-c820-4f91-9d85-143f1dd7e75a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:14.810040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97effce9-c820-4f91-9d85-143f1dd7e75a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:14.827593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-97effce9-c820-4f91-9d85-143f1dd7e75a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:14.828732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 211/421] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:14.834230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e1666-ad78-4e50-955a-7157b142fbfb admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.844025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e1666-ad78-4e50-955a-7157b142fbfb admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.847835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1af3c5-0fe4-4018-8069-0e8b24a075ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.848417 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1af3c5-0fe4-4018-8069-0e8b24a075ed admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.848702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1af3c5-0fe4-4018-8069-0e8b24a075ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.848981 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1af3c5-0fe4-4018-8069-0e8b24a075ed admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.849666 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1af3c5-0fe4-4018-8069-0e8b24a075ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:14.849964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1af3c5-0fe4-4018-8069-0e8b24a075ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:14.875620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1af3c5-0fe4-4018-8069-0e8b24a075ed admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:14.887739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 211/422] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:14.893712 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97effce9-c820-4f91-9d85-143f1dd7e75a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.902940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97effce9-c820-4f91-9d85-143f1dd7e75a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.906964 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789f65-3609-4155-932c-5aaf270657e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.907666 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789f65-3609-4155-932c-5aaf270657e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.907952 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789f65-3609-4155-932c-5aaf270657e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.908231 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789f65-3609-4155-932c-5aaf270657e6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.916956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789f65-3609-4155-932c-5aaf270657e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:14.942651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789f65-3609-4155-932c-5aaf270657e6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:14.956654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-41789f65-3609-4155-932c-5aaf270657e6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:14.957704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 212/423] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:14.963264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1af3c5-0fe4-4018-8069-0e8b24a075ed admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:14.972837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1af3c5-0fe4-4018-8069-0e8b24a075ed admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:14.976817 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a0ffe-7c98-4abb-aa18-5cb3cea114d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:14.977407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a0ffe-7c98-4abb-aa18-5cb3cea114d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:14.977700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a0ffe-7c98-4abb-aa18-5cb3cea114d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:14.977985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a0ffe-7c98-4abb-aa18-5cb3cea114d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:14.978759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a0ffe-7c98-4abb-aa18-5cb3cea114d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:14.979067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a0ffe-7c98-4abb-aa18-5cb3cea114d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:15.005120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a0ffe-7c98-4abb-aa18-5cb3cea114d8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:15.019145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 212/424] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:15.024967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789f65-3609-4155-932c-5aaf270657e6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:15.034202 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789f65-3609-4155-932c-5aaf270657e6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:15.038078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e73313-5092-4833-bec2-5c2bd93523a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:15.038921 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e73313-5092-4833-bec2-5c2bd93523a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:15.039214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e73313-5092-4833-bec2-5c2bd93523a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:15.039501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e73313-5092-4833-bec2-5c2bd93523a6 admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/a523c35d222f464e9d4f78ae990e3a17/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:15.041223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e73313-5092-4833-bec2-5c2bd93523a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=a523c35d222f464e9d4f78ae990e3a17, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:15.068026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e73313-5092-4833-bec2-5c2bd93523a6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:15.080468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 213/425] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:56:15 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/a523c35d222f464e9d4f78ae990e3a17/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:56:17.053271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dfa44-c936-4ea4-b9c3-3589f6282f73 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.053788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dfa44-c936-4ea4-b9c3-3589f6282f73 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.053894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dfa44-c936-4ea4-b9c3-3589f6282f73 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.055520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 213/426] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:17.060864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c837db-8647-4bb8-b720-bfe268d7a7a7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.061265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c837db-8647-4bb8-b720-bfe268d7a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.061472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c837db-8647-4bb8-b720-bfe268d7a7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.084731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-d6c837db-8647-4bb8-b720-bfe268d7a7a7 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:17.085859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d6c837db-8647-4bb8-b720-bfe268d7a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:17.153142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 214/427] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:17.175845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dfa44-c936-4ea4-b9c3-3589f6282f73 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.191757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dfa44-c936-4ea4-b9c3-3589f6282f73 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.195656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d5f10-300a-40df-866d-01a515d48144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.196378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d5f10-300a-40df-866d-01a515d48144 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.196671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d5f10-300a-40df-866d-01a515d48144 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.196955 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d5f10-300a-40df-866d-01a515d48144 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.212875 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d5f10-300a-40df-866d-01a515d48144 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:17.219368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-5e1d5f10-300a-40df-866d-01a515d48144 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:56:17.220508 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 214/428] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:17.226910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c837db-8647-4bb8-b720-bfe268d7a7a7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.236212 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c837db-8647-4bb8-b720-bfe268d7a7a7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.241756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c0ed-f40d-4239-81d9-9039c8bbef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.242363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c0ed-f40d-4239-81d9-9039c8bbef2c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.242686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c0ed-f40d-4239-81d9-9039c8bbef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.242973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c0ed-f40d-4239-81d9-9039c8bbef2c admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.243772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c0ed-f40d-4239-81d9-9039c8bbef2c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:17.244077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c0ed-f40d-4239-81d9-9039c8bbef2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.277438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c0ed-f40d-4239-81d9-9039c8bbef2c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.288741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 215/429] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:17.295008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d5f10-300a-40df-866d-01a515d48144 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.305478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d5f10-300a-40df-866d-01a515d48144 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.311253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fd367-c56a-43a5-869a-8071629ed654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.312873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fd367-c56a-43a5-869a-8071629ed654 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.313169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fd367-c56a-43a5-869a-8071629ed654 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.313457 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fd367-c56a-43a5-869a-8071629ed654 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.325462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fd367-c56a-43a5-869a-8071629ed654 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.354757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fd367-c56a-43a5-869a-8071629ed654 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.376181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-624fd367-c56a-43a5-869a-8071629ed654 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:17.377325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 215/430] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:17.382999 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c0ed-f40d-4239-81d9-9039c8bbef2c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.394271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c0ed-f40d-4239-81d9-9039c8bbef2c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.400018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8823-b028-487b-8850-d46f80c8a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.400971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8823-b028-487b-8850-d46f80c8a4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.401446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8823-b028-487b-8850-d46f80c8a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.401908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8823-b028-487b-8850-d46f80c8a4c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.403074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e8823-b028-487b-8850-d46f80c8a4c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:17.403579 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e8823-b028-487b-8850-d46f80c8a4c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.430642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e8823-b028-487b-8850-d46f80c8a4c3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.448821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 216/431] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:17.455191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fd367-c56a-43a5-869a-8071629ed654 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.464840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fd367-c56a-43a5-869a-8071629ed654 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.469141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30cbf0-9262-43b3-8d3f-29a95b18aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.469860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30cbf0-9262-43b3-8d3f-29a95b18aade admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.470146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30cbf0-9262-43b3-8d3f-29a95b18aade admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.470427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30cbf0-9262-43b3-8d3f-29a95b18aade admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.485800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30cbf0-9262-43b3-8d3f-29a95b18aade admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.512108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30cbf0-9262-43b3-8d3f-29a95b18aade admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.532926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-da30cbf0-9262-43b3-8d3f-29a95b18aade admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:56:17.533983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 216/432] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:17.539814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8823-b028-487b-8850-d46f80c8a4c3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.551063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8823-b028-487b-8850-d46f80c8a4c3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.555120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b40dc-2100-46ac-8386-fdf4aede44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.555719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b40dc-2100-46ac-8386-fdf4aede44ff admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.556012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b40dc-2100-46ac-8386-fdf4aede44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.556297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b40dc-2100-46ac-8386-fdf4aede44ff admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.557097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b40dc-2100-46ac-8386-fdf4aede44ff admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:17.557399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b40dc-2100-46ac-8386-fdf4aede44ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.586185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b40dc-2100-46ac-8386-fdf4aede44ff admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.619303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 217/433] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:17.625895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30cbf0-9262-43b3-8d3f-29a95b18aade admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.635674 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30cbf0-9262-43b3-8d3f-29a95b18aade admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.640620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0c45d-8663-4ce0-b347-63cc782229e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.641211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0c45d-8663-4ce0-b347-63cc782229e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.641499 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0c45d-8663-4ce0-b347-63cc782229e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.641773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0c45d-8663-4ce0-b347-63cc782229e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.650610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0c45d-8663-4ce0-b347-63cc782229e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.682683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0c45d-8663-4ce0-b347-63cc782229e7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.693239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 217/434] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:56:17.700621 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b40dc-2100-46ac-8386-fdf4aede44ff admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.711789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b40dc-2100-46ac-8386-fdf4aede44ff admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.715905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f196cb-4691-425c-947b-e5a072e64ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.716704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f196cb-4691-425c-947b-e5a072e64ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.717002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f196cb-4691-425c-947b-e5a072e64ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.717286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f196cb-4691-425c-947b-e5a072e64ca8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.736321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f196cb-4691-425c-947b-e5a072e64ca8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.766139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f196cb-4691-425c-947b-e5a072e64ca8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.789036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-00f196cb-4691-425c-947b-e5a072e64ca8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:17.790377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 218/435] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:17.796124 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0c45d-8663-4ce0-b347-63cc782229e7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.804934 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0c45d-8663-4ce0-b347-63cc782229e7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.808910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e9b14-2fa7-4787-a6d7-02a3ce890e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.809508 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e9b14-2fa7-4787-a6d7-02a3ce890e17 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.809915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e9b14-2fa7-4787-a6d7-02a3ce890e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.810208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e9b14-2fa7-4787-a6d7-02a3ce890e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.810928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e9b14-2fa7-4787-a6d7-02a3ce890e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:17.811236 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e9b14-2fa7-4787-a6d7-02a3ce890e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.840355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e9b14-2fa7-4787-a6d7-02a3ce890e17 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.854650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 218/436] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:17.861615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f196cb-4691-425c-947b-e5a072e64ca8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.877009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f196cb-4691-425c-947b-e5a072e64ca8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.880904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c648e-801f-4dee-a8b1-e43bb55dfc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.881620 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c648e-801f-4dee-a8b1-e43bb55dfc1f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.881899 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c648e-801f-4dee-a8b1-e43bb55dfc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.882180 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c648e-801f-4dee-a8b1-e43bb55dfc1f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.892177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c648e-801f-4dee-a8b1-e43bb55dfc1f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.917441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c648e-801f-4dee-a8b1-e43bb55dfc1f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.931203 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-2c0c648e-801f-4dee-a8b1-e43bb55dfc1f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:17.932372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 219/437] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:17.938869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e9b14-2fa7-4787-a6d7-02a3ce890e17 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:17.948371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e9b14-2fa7-4787-a6d7-02a3ce890e17 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:17.953010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6888c-0ecc-4cb8-8fa0-c48101a3e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:17.953592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6888c-0ecc-4cb8-8fa0-c48101a3e91c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:17.953883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6888c-0ecc-4cb8-8fa0-c48101a3e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:17.954166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6888c-0ecc-4cb8-8fa0-c48101a3e91c admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:17.954945 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6888c-0ecc-4cb8-8fa0-c48101a3e91c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:17.955248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6888c-0ecc-4cb8-8fa0-c48101a3e91c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:17.980893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6888c-0ecc-4cb8-8fa0-c48101a3e91c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:17.994645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 219/438] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:18.001039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c648e-801f-4dee-a8b1-e43bb55dfc1f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:18.010265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c648e-801f-4dee-a8b1-e43bb55dfc1f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:18.014163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be0f34-b833-43b9-a31b-4726fc5ffd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:18.015530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be0f34-b833-43b9-a31b-4726fc5ffd8f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:18.015821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be0f34-b833-43b9-a31b-4726fc5ffd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:18.016099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be0f34-b833-43b9-a31b-4726fc5ffd8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:18.016869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be0f34-b833-43b9-a31b-4726fc5ffd8f admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=a523c35d222f464e9d4f78ae990e3a17) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:18.017171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be0f34-b833-43b9-a31b-4726fc5ffd8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:18.042471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be0f34-b833-43b9-a31b-4726fc5ffd8f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:18.048695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 220/439] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:56:18 2021] GET /identity/v3/role_assignments?user.id=a523c35d222f464e9d4f78ae990e3a17&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:20.054649 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54d76d-1eba-4ef3-a1e0-1e624f14e4ec None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:20.055142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54d76d-1eba-4ef3-a1e0-1e624f14e4ec None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:20.055247 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54d76d-1eba-4ef3-a1e0-1e624f14e4ec None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:20.056878 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 220/440] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:20.062000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde84cb-589d-49ee-b7d6-1cacd9c84520 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:20.062413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde84cb-589d-49ee-b7d6-1cacd9c84520 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:20.062646 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde84cb-589d-49ee-b7d6-1cacd9c84520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:20.085188 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-2cde84cb-589d-49ee-b7d6-1cacd9c84520 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:20.086312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2cde84cb-589d-49ee-b7d6-1cacd9c84520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:20.092922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 221/441] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:20.114308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54d76d-1eba-4ef3-a1e0-1e624f14e4ec None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:20.126366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54d76d-1eba-4ef3-a1e0-1e624f14e4ec None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:20.130070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:20.130831 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:20.131120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:20.131397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:20.132009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:20.157443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:20.157443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:56:20.157443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:56:20.158323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:20.170262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:56:20.172043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 221/442] 10.222.0.36 () {56 vars in 1153 bytes} [Wed Oct 27 13:56:20 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:20.177852 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde84cb-589d-49ee-b7d6-1cacd9c84520 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:20.186463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde84cb-589d-49ee-b7d6-1cacd9c84520 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:20.190412 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a48b10-baa7-4225-9d9d-231028d15df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:20.191031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a48b10-baa7-4225-9d9d-231028d15df2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:20.191322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a48b10-baa7-4225-9d9d-231028d15df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:20.191608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a48b10-baa7-4225-9d9d-231028d15df2 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:20.192278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a48b10-baa7-4225-9d9d-231028d15df2 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:20.192580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a48b10-baa7-4225-9d9d-231028d15df2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:20.217246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-18a48b10-baa7-4225-9d9d-231028d15df2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:20.217246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:56:20.217246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:56:20.218788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a48b10-baa7-4225-9d9d-231028d15df2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:20.223123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 222/443] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:56:20 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:20.228363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:20.238804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccd871-49d4-434b-8804-3e5962abcb91 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:20.242780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa01570-d74d-4612-a9a5-84a2bd10f1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:20.243371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa01570-d74d-4612-a9a5-84a2bd10f1fb admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:20.243663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa01570-d74d-4612-a9a5-84a2bd10f1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:20.243949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa01570-d74d-4612-a9a5-84a2bd10f1fb admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:20.244624 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa01570-d74d-4612-a9a5-84a2bd10f1fb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:20.244926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa01570-d74d-4612-a9a5-84a2bd10f1fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:20.269334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-9fa01570-d74d-4612-a9a5-84a2bd10f1fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:20.269334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:56:20.269334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:56:20.270151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa01570-d74d-4612-a9a5-84a2bd10f1fb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:20.275300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 222/444] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:56:20 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:22.233693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da74b-097f-46f6-8fe6-c864bae23c58 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:22.234211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da74b-097f-46f6-8fe6-c864bae23c58 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:22.234297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da74b-097f-46f6-8fe6-c864bae23c58 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:22.236242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 223/445] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:22.241532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb4e6-26a9-4d88-be4a-b92411e5f445 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:22.241919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb4e6-26a9-4d88-be4a-b92411e5f445 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:22.242109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb4e6-26a9-4d88-be4a-b92411e5f445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:22.264322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-56ffb4e6-26a9-4d88-be4a-b92411e5f445 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:22.266025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-56ffb4e6-26a9-4d88-be4a-b92411e5f445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:22.272651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 223/446] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:22.294782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da74b-097f-46f6-8fe6-c864bae23c58 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:22.309412 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da74b-097f-46f6-8fe6-c864bae23c58 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:22.313444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9d683-8de0-4082-8032-0164efc7b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:22.314044 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9d683-8de0-4082-8032-0164efc7b25b admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:22.314332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9d683-8de0-4082-8032-0164efc7b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:22.314612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9d683-8de0-4082-8032-0164efc7b25b admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:22.315312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9d683-8de0-4082-8032-0164efc7b25b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:22.340236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-dfa9d683-8de0-4082-8032-0164efc7b25b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:22.340236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:56:22.340236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:56:22.341096 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9d683-8de0-4082-8032-0164efc7b25b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:22.355873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 224/447] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:56:22 2021] POST /identity/v3/services => generated 269 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:56:24.318165 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333f28a-46b5-4317-b69f-7bfff81699f2 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:24.318710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333f28a-46b5-4317-b69f-7bfff81699f2 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:24.318710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333f28a-46b5-4317-b69f-7bfff81699f2 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:24.320361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 224/448] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:24.325674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a68bb-6a5f-485d-b895-9d3ecc0811b9 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:24.326115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a68bb-6a5f-485d-b895-9d3ecc0811b9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:24.326222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a68bb-6a5f-485d-b895-9d3ecc0811b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:24.350394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-610a68bb-6a5f-485d-b895-9d3ecc0811b9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:24.351557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-610a68bb-6a5f-485d-b895-9d3ecc0811b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:24.367550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 225/449] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:24 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:24.389054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333f28a-46b5-4317-b69f-7bfff81699f2 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:24.401630 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333f28a-46b5-4317-b69f-7bfff81699f2 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:24.406147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7004d5-eb63-4cfb-8cae-ed6e3fdf7d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:24.406835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7004d5-eb63-4cfb-8cae-ed6e3fdf7d1c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:24.407127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7004d5-eb63-4cfb-8cae-ed6e3fdf7d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:24.407411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7004d5-eb63-4cfb-8cae-ed6e3fdf7d1c admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:24.408026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7004d5-eb63-4cfb-8cae-ed6e3fdf7d1c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:24.432839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7004d5-eb63-4cfb-8cae-ed6e3fdf7d1c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:24.443762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-0c7004d5-eb63-4cfb-8cae-ed6e3fdf7d1c admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:56:24.444831 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 225/450] 10.222.0.36 () {56 vars in 1153 bytes} [Wed Oct 27 13:56:24 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:24.450716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a68bb-6a5f-485d-b895-9d3ecc0811b9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:24.459917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a68bb-6a5f-485d-b895-9d3ecc0811b9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:24.463856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b45683-5b0c-4ab8-84e5-77cd80df7b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:24.464440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45683-5b0c-4ab8-84e5-77cd80df7b16 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:24.464733 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45683-5b0c-4ab8-84e5-77cd80df7b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:24.465017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45683-5b0c-4ab8-84e5-77cd80df7b16 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:24.465694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b45683-5b0c-4ab8-84e5-77cd80df7b16 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:24.465994 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b45683-5b0c-4ab8-84e5-77cd80df7b16 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:24.492446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b45683-5b0c-4ab8-84e5-77cd80df7b16 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:24.496743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 226/451] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:56:24 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:24.502303 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7004d5-eb63-4cfb-8cae-ed6e3fdf7d1c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:24.511413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7004d5-eb63-4cfb-8cae-ed6e3fdf7d1c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:24.515918 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bbecd-1658-4170-8375-18ed69fb61d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:24.516495 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bbecd-1658-4170-8375-18ed69fb61d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:24.516785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bbecd-1658-4170-8375-18ed69fb61d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:24.517068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bbecd-1658-4170-8375-18ed69fb61d9 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:24.517732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bbecd-1658-4170-8375-18ed69fb61d9 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:24.518033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bbecd-1658-4170-8375-18ed69fb61d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:24.542873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bbecd-1658-4170-8375-18ed69fb61d9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:24.548119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 226/452] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:56:24 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:24.553622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b45683-5b0c-4ab8-84e5-77cd80df7b16 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:24.563411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b45683-5b0c-4ab8-84e5-77cd80df7b16 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:24.567406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa83bcf-0254-4405-b2d4-8ea8aff30461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:24.567983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa83bcf-0254-4405-b2d4-8ea8aff30461 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:24.568322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa83bcf-0254-4405-b2d4-8ea8aff30461 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:24.568562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa83bcf-0254-4405-b2d4-8ea8aff30461 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:24.569306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa83bcf-0254-4405-b2d4-8ea8aff30461 admin admin] RBAC: Adding query filter params (interface=public, service_id=8395d1e8097a402aa1b4016d3a950c12, region_id=RegionOne) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:24.569709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa83bcf-0254-4405-b2d4-8ea8aff30461 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:24.594433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-baa83bcf-0254-4405-b2d4-8ea8aff30461 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:24.594433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:56:24.594433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:56:24.595318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa83bcf-0254-4405-b2d4-8ea8aff30461 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:24.601144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 227/453] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Oct 27 13:56:24 2021] GET /identity/v3/endpoints?service_id=8395d1e8097a402aa1b4016d3a950c12&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:24.606487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bbecd-1658-4170-8375-18ed69fb61d9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:24.616449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bbecd-1658-4170-8375-18ed69fb61d9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:24.620492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e435a4-c227-439f-a790-51c5e8980c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:24.621077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e435a4-c227-439f-a790-51c5e8980c92 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:24.621368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e435a4-c227-439f-a790-51c5e8980c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:24.621650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e435a4-c227-439f-a790-51c5e8980c92 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:24.622290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e435a4-c227-439f-a790-51c5e8980c92 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:24.648018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e435a4-c227-439f-a790-51c5e8980c92 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:24.652786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 227/454] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 13:56:24 2021] GET /identity/v3/services => generated 562 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:26.598986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96512d-8910-4d53-8eb0-01f7f469a373 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:26.599729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96512d-8910-4d53-8eb0-01f7f469a373 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:26.599729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96512d-8910-4d53-8eb0-01f7f469a373 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:26.601190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 228/455] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:26.606220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7ce8b-6498-4693-a04b-c713894eadda None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:26.606599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7ce8b-6498-4693-a04b-c713894eadda None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:26.606821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7ce8b-6498-4693-a04b-c713894eadda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:26.629162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-82a7ce8b-6498-4693-a04b-c713894eadda None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:26.630267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-82a7ce8b-6498-4693-a04b-c713894eadda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:26.636790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 228/456] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:26 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:26.659023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96512d-8910-4d53-8eb0-01f7f469a373 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:26.670379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96512d-8910-4d53-8eb0-01f7f469a373 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:26.674409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:26.675158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:26.675445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:26.675725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:26.676340 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:26.701033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:26.701033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:56:26.701033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:56:26.702508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:26.714272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 13:56:26.715426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 229/457] 10.222.0.36 () {56 vars in 1153 bytes} [Wed Oct 27 13:56:26 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:26.721705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7ce8b-6498-4693-a04b-c713894eadda None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:26.730291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7ce8b-6498-4693-a04b-c713894eadda None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:26.734839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585616b-212a-4b89-a2d8-68fa3f4e5f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:26.735427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585616b-212a-4b89-a2d8-68fa3f4e5f02 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:26.735718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585616b-212a-4b89-a2d8-68fa3f4e5f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:26.736259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585616b-212a-4b89-a2d8-68fa3f4e5f02 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:26.736927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585616b-212a-4b89-a2d8-68fa3f4e5f02 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:26.737227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585616b-212a-4b89-a2d8-68fa3f4e5f02 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:26.762176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585616b-212a-4b89-a2d8-68fa3f4e5f02 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:26.767043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 229/458] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:56:26 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:26.772235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:26.782361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9988-5c9e-4602-b3e7-cbebdbcf470d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:26.786275 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf86e4-8505-413a-80e8-051f435de473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:26.786888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf86e4-8505-413a-80e8-051f435de473 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:26.787179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf86e4-8505-413a-80e8-051f435de473 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:26.787461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf86e4-8505-413a-80e8-051f435de473 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:26.788125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf86e4-8505-413a-80e8-051f435de473 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:26.788422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf86e4-8505-413a-80e8-051f435de473 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:26.814091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf86e4-8505-413a-80e8-051f435de473 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:26.819182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 230/459] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:56:26 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:26.824808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585616b-212a-4b89-a2d8-68fa3f4e5f02 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:26.835113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585616b-212a-4b89-a2d8-68fa3f4e5f02 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:26.838974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1df315-d8ce-45ff-bd90-ec31069475e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:26.839545 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1df315-d8ce-45ff-bd90-ec31069475e6 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:26.839833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1df315-d8ce-45ff-bd90-ec31069475e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:26.840113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1df315-d8ce-45ff-bd90-ec31069475e6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:26.840820 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1df315-d8ce-45ff-bd90-ec31069475e6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:26.866509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-0d1df315-d8ce-45ff-bd90-ec31069475e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:26.866509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:56:26.866509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:56:26.867350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1df315-d8ce-45ff-bd90-ec31069475e6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:26.888755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 230/460] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 13:56:26 2021] POST /identity/v3/endpoints => generated 347 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:56:28.872729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835452-31d8-4812-ae03-bb2d93ac6247 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:28.873308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835452-31d8-4812-ae03-bb2d93ac6247 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:28.873308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835452-31d8-4812-ae03-bb2d93ac6247 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:28.875588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 231/461] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:28.880713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ad10-d0fc-4169-80a3-22054057c3cb None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:28.881113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ad10-d0fc-4169-80a3-22054057c3cb None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:28.881294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ad10-d0fc-4169-80a3-22054057c3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:28.903725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2426ad10-d0fc-4169-80a3-22054057c3cb None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:28.904910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2426ad10-d0fc-4169-80a3-22054057c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:28.925771 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 231/462] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:28 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:28.947294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1835452-31d8-4812-ae03-bb2d93ac6247 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:28.958839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1835452-31d8-4812-ae03-bb2d93ac6247 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:28.962540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a20835-5785-4efa-9766-e868ccd864af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:28.963273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a20835-5785-4efa-9766-e868ccd864af admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:28.963559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a20835-5785-4efa-9766-e868ccd864af admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:28.963840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a20835-5785-4efa-9766-e868ccd864af admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:28.964449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a20835-5785-4efa-9766-e868ccd864af admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:28.990639 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a20835-5785-4efa-9766-e868ccd864af admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:29.001699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-c7a20835-5785-4efa-9766-e868ccd864af admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:56:29.002801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 232/463] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:28 2021] GET /identity/v3/services/compute => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:29.008488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426ad10-d0fc-4169-80a3-22054057c3cb None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:29.017705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426ad10-d0fc-4169-80a3-22054057c3cb None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:29.021697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d29a07-e04b-4310-ab6a-5214f5b5df52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:29.022289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d29a07-e04b-4310-ab6a-5214f5b5df52 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:29.022581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d29a07-e04b-4310-ab6a-5214f5b5df52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:29.022900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d29a07-e04b-4310-ab6a-5214f5b5df52 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:29.023575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d29a07-e04b-4310-ab6a-5214f5b5df52 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:29.023881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d29a07-e04b-4310-ab6a-5214f5b5df52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:29.049643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d29a07-e04b-4310-ab6a-5214f5b5df52 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:29.053923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 232/464] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:56:29 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:29.059341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a20835-5785-4efa-9766-e868ccd864af admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:29.070189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a20835-5785-4efa-9766-e868ccd864af admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:29.074090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325f05-7895-4e3a-8586-cf26ae09b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:29.074697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325f05-7895-4e3a-8586-cf26ae09b04d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:29.074987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325f05-7895-4e3a-8586-cf26ae09b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:29.075267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325f05-7895-4e3a-8586-cf26ae09b04d admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:29.075924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325f05-7895-4e3a-8586-cf26ae09b04d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:29.076221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325f05-7895-4e3a-8586-cf26ae09b04d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:29.100905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325f05-7895-4e3a-8586-cf26ae09b04d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:29.105152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 233/465] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:56:29 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:31.081312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f5fb8-b8fe-4549-aa60-743f6dbb3ab7 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:31.081810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f5fb8-b8fe-4549-aa60-743f6dbb3ab7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:31.081895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f5fb8-b8fe-4549-aa60-743f6dbb3ab7 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:31.083575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 233/466] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:31.088723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cbd08-da8f-48d1-a6f5-96ba4df18da8 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:31.089120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cbd08-da8f-48d1-a6f5-96ba4df18da8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:31.089292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cbd08-da8f-48d1-a6f5-96ba4df18da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:31.112226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-0c0cbd08-da8f-48d1-a6f5-96ba4df18da8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:31.113353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0c0cbd08-da8f-48d1-a6f5-96ba4df18da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:31.120077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 234/467] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:31 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:31.142169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f5fb8-b8fe-4549-aa60-743f6dbb3ab7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:31.158835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f5fb8-b8fe-4549-aa60-743f6dbb3ab7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:31.162871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cc93d-e3d1-4716-808e-64f2f14514b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:31.163465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cc93d-e3d1-4716-808e-64f2f14514b9 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:31.163757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cc93d-e3d1-4716-808e-64f2f14514b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:31.164044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cc93d-e3d1-4716-808e-64f2f14514b9 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:31.164725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cc93d-e3d1-4716-808e-64f2f14514b9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:31.189130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-834cc93d-e3d1-4716-808e-64f2f14514b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:31.189130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:56:31.189130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:56:31.189992 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cc93d-e3d1-4716-808e-64f2f14514b9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:31.204268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 234/468] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:56:31 2021] POST /identity/v3/services => generated 242 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:56:33.207670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec9e67-88a5-4016-8872-5a0e82b2d9b0 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:33.208184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec9e67-88a5-4016-8872-5a0e82b2d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:33.208294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec9e67-88a5-4016-8872-5a0e82b2d9b0 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:33.209893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 235/469] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:33.215090 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f54d7-15f7-4d23-bf26-1d85d8d515a8 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:33.215495 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f54d7-15f7-4d23-bf26-1d85d8d515a8 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:33.215666 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f54d7-15f7-4d23-bf26-1d85d8d515a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:33.238771 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8c9f54d7-15f7-4d23-bf26-1d85d8d515a8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:33.239894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8c9f54d7-15f7-4d23-bf26-1d85d8d515a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:33.256862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 235/470] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:33 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:33.278240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec9e67-88a5-4016-8872-5a0e82b2d9b0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:33.290237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec9e67-88a5-4016-8872-5a0e82b2d9b0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:33.294148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce65d-b2d5-4830-814e-251e7fa644b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:33.294884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce65d-b2d5-4830-814e-251e7fa644b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:33.295179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce65d-b2d5-4830-814e-251e7fa644b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:33.296394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce65d-b2d5-4830-814e-251e7fa644b5 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:33.297114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dce65d-b2d5-4830-814e-251e7fa644b5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:33.323524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dce65d-b2d5-4830-814e-251e7fa644b5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:33.334008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-56dce65d-b2d5-4830-814e-251e7fa644b5 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:56:33.335125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 236/471] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:33 2021] GET /identity/v3/services/compute => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:33.340873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f54d7-15f7-4d23-bf26-1d85d8d515a8 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:33.349325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f54d7-15f7-4d23-bf26-1d85d8d515a8 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:33.353243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de7e10-aa8a-4c5e-8685-6ab516cbd077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:33.353832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de7e10-aa8a-4c5e-8685-6ab516cbd077 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:33.354118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de7e10-aa8a-4c5e-8685-6ab516cbd077 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:33.354399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de7e10-aa8a-4c5e-8685-6ab516cbd077 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:33.355102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de7e10-aa8a-4c5e-8685-6ab516cbd077 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:33.355400 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de7e10-aa8a-4c5e-8685-6ab516cbd077 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:33.381440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de7e10-aa8a-4c5e-8685-6ab516cbd077 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:33.385731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 236/472] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:56:33 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:33.391114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce65d-b2d5-4830-814e-251e7fa644b5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:33.400290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce65d-b2d5-4830-814e-251e7fa644b5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:33.404215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f2c5-4e41-457a-88fe-c02ae45bbc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:33.405222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f2c5-4e41-457a-88fe-c02ae45bbc99 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:33.405556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f2c5-4e41-457a-88fe-c02ae45bbc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:33.405686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f2c5-4e41-457a-88fe-c02ae45bbc99 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:33.406352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74f2c5-4e41-457a-88fe-c02ae45bbc99 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:33.406687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74f2c5-4e41-457a-88fe-c02ae45bbc99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:33.432218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74f2c5-4e41-457a-88fe-c02ae45bbc99 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:33.437581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 237/473] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:56:33 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:33.443239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de7e10-aa8a-4c5e-8685-6ab516cbd077 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:33.452557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de7e10-aa8a-4c5e-8685-6ab516cbd077 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:33.456551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c05f-f4d4-4d24-9f64-63317f5aba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:33.457127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c05f-f4d4-4d24-9f64-63317f5aba5c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:33.457415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c05f-f4d4-4d24-9f64-63317f5aba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:33.457699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c05f-f4d4-4d24-9f64-63317f5aba5c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:33.458430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c05f-f4d4-4d24-9f64-63317f5aba5c admin admin] RBAC: Adding query filter params (interface=public, service_id=8e44222fbbb3407caf42008928ab3263, region_id=RegionOne) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:33.458768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c05f-f4d4-4d24-9f64-63317f5aba5c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:33.483715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-bd29c05f-f4d4-4d24-9f64-63317f5aba5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:33.483715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:56:33.483715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:56:33.485117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c05f-f4d4-4d24-9f64-63317f5aba5c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:33.491549 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 237/474] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Oct 27 13:56:33 2021] GET /identity/v3/endpoints?service_id=8e44222fbbb3407caf42008928ab3263&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:33.497109 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f2c5-4e41-457a-88fe-c02ae45bbc99 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:33.506920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f2c5-4e41-457a-88fe-c02ae45bbc99 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:33.510871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fc484-7e9f-43db-8f00-45b92e86797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:33.511454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc484-7e9f-43db-8f00-45b92e86797e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:33.511747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc484-7e9f-43db-8f00-45b92e86797e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:33.512032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc484-7e9f-43db-8f00-45b92e86797e admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:33.512677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fc484-7e9f-43db-8f00-45b92e86797e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:33.539309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fc484-7e9f-43db-8f00-45b92e86797e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:33.544276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 238/475] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 13:56:33 2021] GET /identity/v3/services => generated 792 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:35.526349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3421ab9-3e4f-40f7-b538-7a46035b7155 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:35.526972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3421ab9-3e4f-40f7-b538-7a46035b7155 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:35.526972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3421ab9-3e4f-40f7-b538-7a46035b7155 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:35.528632 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 238/476] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:35.533728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60014fed-8f66-4e8b-bdc0-cddd02cf8758 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:35.534157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60014fed-8f66-4e8b-bdc0-cddd02cf8758 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:35.534304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60014fed-8f66-4e8b-bdc0-cddd02cf8758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:35.556948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-60014fed-8f66-4e8b-bdc0-cddd02cf8758 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:35.558076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-60014fed-8f66-4e8b-bdc0-cddd02cf8758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:35.565527 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 239/477] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:35 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:35.587261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3421ab9-3e4f-40f7-b538-7a46035b7155 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:35.599042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3421ab9-3e4f-40f7-b538-7a46035b7155 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:35.602819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51227d65-3bef-44bf-8cbd-0a6d79b2a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:35.603532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51227d65-3bef-44bf-8cbd-0a6d79b2a2da admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:35.603824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51227d65-3bef-44bf-8cbd-0a6d79b2a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:35.604108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51227d65-3bef-44bf-8cbd-0a6d79b2a2da admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:35.604730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51227d65-3bef-44bf-8cbd-0a6d79b2a2da admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:35.631638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51227d65-3bef-44bf-8cbd-0a6d79b2a2da admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:35.642227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-51227d65-3bef-44bf-8cbd-0a6d79b2a2da admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 13:56:35.643290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 239/478] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:35 2021] GET /identity/v3/services/compute => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:35.648814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60014fed-8f66-4e8b-bdc0-cddd02cf8758 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:35.657362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60014fed-8f66-4e8b-bdc0-cddd02cf8758 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:35.661228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c523182-95ae-4eeb-b314-5d51e0319a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:35.661811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c523182-95ae-4eeb-b314-5d51e0319a16 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:35.662099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c523182-95ae-4eeb-b314-5d51e0319a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:35.662381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c523182-95ae-4eeb-b314-5d51e0319a16 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:35.663075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c523182-95ae-4eeb-b314-5d51e0319a16 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:35.663373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c523182-95ae-4eeb-b314-5d51e0319a16 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:35.689661 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c523182-95ae-4eeb-b314-5d51e0319a16 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:35.694276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 240/479] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:56:35 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:35.702867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51227d65-3bef-44bf-8cbd-0a6d79b2a2da admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:35.712114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51227d65-3bef-44bf-8cbd-0a6d79b2a2da admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:35.716118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e1143-e53d-4120-b2ef-a0c8c125baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:35.716700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e1143-e53d-4120-b2ef-a0c8c125baa2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:35.716989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e1143-e53d-4120-b2ef-a0c8c125baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:35.717364 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e1143-e53d-4120-b2ef-a0c8c125baa2 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:35.718213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e1143-e53d-4120-b2ef-a0c8c125baa2 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:35.718510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e1143-e53d-4120-b2ef-a0c8c125baa2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:35.744663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e1143-e53d-4120-b2ef-a0c8c125baa2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:35.750135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 240/480] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:56:35 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:35.755644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c523182-95ae-4eeb-b314-5d51e0319a16 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:35.764808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c523182-95ae-4eeb-b314-5d51e0319a16 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:35.768641 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b844413-fb06-4ce8-a46d-fec22a8c2430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:35.769216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844413-fb06-4ce8-a46d-fec22a8c2430 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:35.769506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844413-fb06-4ce8-a46d-fec22a8c2430 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:35.769789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b844413-fb06-4ce8-a46d-fec22a8c2430 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:35.770474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b844413-fb06-4ce8-a46d-fec22a8c2430 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:35.795797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-1b844413-fb06-4ce8-a46d-fec22a8c2430 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:56:35.795797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:56:35.795797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:56:35.796606 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b844413-fb06-4ce8-a46d-fec22a8c2430 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:35.815830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 241/481] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 13:56:35 2021] POST /identity/v3/endpoints => generated 334 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:56:37.860133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08e41d-186a-4af5-b2a9-476db24ffad7 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:37.860692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08e41d-186a-4af5-b2a9-476db24ffad7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:37.860692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08e41d-186a-4af5-b2a9-476db24ffad7 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:37.862596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 241/482] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:37.867703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35de3-befe-4100-a3cb-ebaa88d9b2f8 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:37.868116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35de3-befe-4100-a3cb-ebaa88d9b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:37.868269 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35de3-befe-4100-a3cb-ebaa88d9b2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:37.891194 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-2af35de3-befe-4100-a3cb-ebaa88d9b2f8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:37.892322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2af35de3-befe-4100-a3cb-ebaa88d9b2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:37.908005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 242/483] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:37 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:37.930313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08e41d-186a-4af5-b2a9-476db24ffad7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:37.942211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08e41d-186a-4af5-b2a9-476db24ffad7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:37.945994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8bf1-af9b-40a1-8df4-cc5149cd16f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:37.946781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8bf1-af9b-40a1-8df4-cc5149cd16f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:37.947053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8bf1-af9b-40a1-8df4-cc5149cd16f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:37.947456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8bf1-af9b-40a1-8df4-cc5149cd16f1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:37.959896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc8bf1-af9b-40a1-8df4-cc5149cd16f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:37.966688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-c2dc8bf1-af9b-40a1-8df4-cc5149cd16f1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:56:37.967972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 242/484] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Oct 27 13:56:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:37.973758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35de3-befe-4100-a3cb-ebaa88d9b2f8 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:37.982398 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35de3-befe-4100-a3cb-ebaa88d9b2f8 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:37.987160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789979a3-bd65-4c9e-8a99-0eee5926961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:37.987753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789979a3-bd65-4c9e-8a99-0eee5926961d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:37.988046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789979a3-bd65-4c9e-8a99-0eee5926961d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:37.988332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789979a3-bd65-4c9e-8a99-0eee5926961d admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:37.989037 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789979a3-bd65-4c9e-8a99-0eee5926961d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:37.989340 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789979a3-bd65-4c9e-8a99-0eee5926961d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.015320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789979a3-bd65-4c9e-8a99-0eee5926961d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.024414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 243/485] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Oct 27 13:56:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:38.030112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8bf1-af9b-40a1-8df4-cc5149cd16f1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.041725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8bf1-af9b-40a1-8df4-cc5149cd16f1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.047066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468f080-162b-4df5-a5c4-528b797bb9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.048632 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468f080-162b-4df5-a5c4-528b797bb9ec admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.048926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468f080-162b-4df5-a5c4-528b797bb9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.049212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468f080-162b-4df5-a5c4-528b797bb9ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.061442 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468f080-162b-4df5-a5c4-528b797bb9ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.086464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468f080-162b-4df5-a5c4-528b797bb9ec admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.103143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-f468f080-162b-4df5-a5c4-528b797bb9ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:38.104207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 243/486] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:38.110408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789979a3-bd65-4c9e-8a99-0eee5926961d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.119810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789979a3-bd65-4c9e-8a99-0eee5926961d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.124368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dbe01-c3d1-4b4f-8075-bac6bed23cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.124941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dbe01-c3d1-4b4f-8075-bac6bed23cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.125231 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dbe01-c3d1-4b4f-8075-bac6bed23cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.125513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dbe01-c3d1-4b4f-8075-bac6bed23cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.126189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dbe01-c3d1-4b4f-8075-bac6bed23cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:38.126486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dbe01-c3d1-4b4f-8075-bac6bed23cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.151517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dbe01-c3d1-4b4f-8075-bac6bed23cc2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.164626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 244/487] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:38.169934 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468f080-162b-4df5-a5c4-528b797bb9ec admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.179813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468f080-162b-4df5-a5c4-528b797bb9ec admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.183675 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfcd21-3306-44ba-b126-66ab3603503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.184381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfcd21-3306-44ba-b126-66ab3603503e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.184673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfcd21-3306-44ba-b126-66ab3603503e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.184963 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfcd21-3306-44ba-b126-66ab3603503e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.198139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfcd21-3306-44ba-b126-66ab3603503e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.223948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfcd21-3306-44ba-b126-66ab3603503e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.242451 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-9ccfcd21-3306-44ba-b126-66ab3603503e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:56:38.243558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 244/488] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:38.249104 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dbe01-c3d1-4b4f-8075-bac6bed23cc2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.258329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dbe01-c3d1-4b4f-8075-bac6bed23cc2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.262209 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea27ad3-a7d5-485f-80d5-2d15b43b3e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.262826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea27ad3-a7d5-485f-80d5-2d15b43b3e8f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.263116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea27ad3-a7d5-485f-80d5-2d15b43b3e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.263397 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea27ad3-a7d5-485f-80d5-2d15b43b3e8f admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.264209 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea27ad3-a7d5-485f-80d5-2d15b43b3e8f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:38.264512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea27ad3-a7d5-485f-80d5-2d15b43b3e8f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.290129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea27ad3-a7d5-485f-80d5-2d15b43b3e8f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.319291 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 245/489] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:38.324960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfcd21-3306-44ba-b126-66ab3603503e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.334190 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfcd21-3306-44ba-b126-66ab3603503e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.339183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90882cf-5e19-4c6d-8a81-ce8b15405b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.339755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90882cf-5e19-4c6d-8a81-ce8b15405b89 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.340046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90882cf-5e19-4c6d-8a81-ce8b15405b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.340330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90882cf-5e19-4c6d-8a81-ce8b15405b89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.348379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90882cf-5e19-4c6d-8a81-ce8b15405b89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.374343 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90882cf-5e19-4c6d-8a81-ce8b15405b89 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.383570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 245/490] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:56:38.389262 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea27ad3-a7d5-485f-80d5-2d15b43b3e8f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.398435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea27ad3-a7d5-485f-80d5-2d15b43b3e8f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.402250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc431c6-ffb8-40a5-9480-a1e56c506a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.402994 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc431c6-ffb8-40a5-9480-a1e56c506a27 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.403284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc431c6-ffb8-40a5-9480-a1e56c506a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.403571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc431c6-ffb8-40a5-9480-a1e56c506a27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.415619 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc431c6-ffb8-40a5-9480-a1e56c506a27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.441667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc431c6-ffb8-40a5-9480-a1e56c506a27 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.458505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-0bc431c6-ffb8-40a5-9480-a1e56c506a27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:38.459614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 246/491] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:38.465264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90882cf-5e19-4c6d-8a81-ce8b15405b89 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.474434 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90882cf-5e19-4c6d-8a81-ce8b15405b89 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.478415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6a0de-6500-4f6c-afd0-b28e8383f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.479023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6a0de-6500-4f6c-afd0-b28e8383f653 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.479312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6a0de-6500-4f6c-afd0-b28e8383f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.479591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6a0de-6500-4f6c-afd0-b28e8383f653 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.480265 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6a0de-6500-4f6c-afd0-b28e8383f653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:38.480561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6a0de-6500-4f6c-afd0-b28e8383f653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.506155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6a0de-6500-4f6c-afd0-b28e8383f653 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.518828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 246/492] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:38.524377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc431c6-ffb8-40a5-9480-a1e56c506a27 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.534201 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc431c6-ffb8-40a5-9480-a1e56c506a27 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.538075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40c34d-170d-4931-9983-f86619a64b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.538817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40c34d-170d-4931-9983-f86619a64b7a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.539105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40c34d-170d-4931-9983-f86619a64b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.539382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40c34d-170d-4931-9983-f86619a64b7a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.549638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40c34d-170d-4931-9983-f86619a64b7a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.577042 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40c34d-170d-4931-9983-f86619a64b7a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.590713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-4c40c34d-170d-4931-9983-f86619a64b7a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:38.591778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 247/493] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:38.598055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6a0de-6500-4f6c-afd0-b28e8383f653 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.607154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6a0de-6500-4f6c-afd0-b28e8383f653 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.611350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a32413-f3f0-4dcb-9b44-3cd8d7a8d909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.611927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a32413-f3f0-4dcb-9b44-3cd8d7a8d909 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.612211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a32413-f3f0-4dcb-9b44-3cd8d7a8d909 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.612489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a32413-f3f0-4dcb-9b44-3cd8d7a8d909 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.613221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a32413-f3f0-4dcb-9b44-3cd8d7a8d909 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:38.613522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a32413-f3f0-4dcb-9b44-3cd8d7a8d909 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.638580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a32413-f3f0-4dcb-9b44-3cd8d7a8d909 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.651769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 247/494] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:38.658031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40c34d-170d-4931-9983-f86619a64b7a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:38.667205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40c34d-170d-4931-9983-f86619a64b7a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:38.671119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72607ac-a75d-48fc-bf02-4cb35ec72b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:38.671683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72607ac-a75d-48fc-bf02-4cb35ec72b34 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:38.671973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72607ac-a75d-48fc-bf02-4cb35ec72b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:38.672254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72607ac-a75d-48fc-bf02-4cb35ec72b34 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:38.673027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72607ac-a75d-48fc-bf02-4cb35ec72b34 admin admin] RBAC: Adding query filter params (role.id=bc2009b7668f441490dbec4c26f77ba8, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=a523c35d222f464e9d4f78ae990e3a17) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:38.673417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72607ac-a75d-48fc-bf02-4cb35ec72b34 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:38.698356 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72607ac-a75d-48fc-bf02-4cb35ec72b34 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:38.704282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 248/495] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:56:38 2021] GET /identity/v3/role_assignments?user.id=a523c35d222f464e9d4f78ae990e3a17&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=bc2009b7668f441490dbec4c26f77ba8 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:40.630159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b770f57-d070-4bc6-8b12-cda8cb16ebca None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:40.630743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b770f57-d070-4bc6-8b12-cda8cb16ebca None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:40.630901 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b770f57-d070-4bc6-8b12-cda8cb16ebca None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:40.632572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 248/496] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:40.637743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5c5a5-1e0a-42d5-b928-81f13020670b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:40.638154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5c5a5-1e0a-42d5-b928-81f13020670b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:40.638354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5c5a5-1e0a-42d5-b928-81f13020670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:40.661956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-2fe5c5a5-1e0a-42d5-b928-81f13020670b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:40.663140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2fe5c5a5-1e0a-42d5-b928-81f13020670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:40.669794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 249/497] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:40 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:40.691914 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b770f57-d070-4bc6-8b12-cda8cb16ebca None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:40.703592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b770f57-d070-4bc6-8b12-cda8cb16ebca None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:40.707439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2cfe6-7577-4b83-9c2d-36192a27b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:40.708165 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2cfe6-7577-4b83-9c2d-36192a27b161 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:40.708452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2cfe6-7577-4b83-9c2d-36192a27b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:40.708733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2cfe6-7577-4b83-9c2d-36192a27b161 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:40.720389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2cfe6-7577-4b83-9c2d-36192a27b161 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:40.726959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-f8a2cfe6-7577-4b83-9c2d-36192a27b161 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:56:40.728015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 249/498] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Oct 27 13:56:40 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:40.734520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5c5a5-1e0a-42d5-b928-81f13020670b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:40.743382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5c5a5-1e0a-42d5-b928-81f13020670b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:40.747304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83625092-b1dc-494c-b174-b7f924b44649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:40.747889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83625092-b1dc-494c-b174-b7f924b44649 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:40.748250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83625092-b1dc-494c-b174-b7f924b44649 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:40.748743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83625092-b1dc-494c-b174-b7f924b44649 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:40.749562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83625092-b1dc-494c-b174-b7f924b44649 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:40.749858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83625092-b1dc-494c-b174-b7f924b44649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:40.775806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83625092-b1dc-494c-b174-b7f924b44649 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:40.785003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 250/499] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Oct 27 13:56:40 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:40.790390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2cfe6-7577-4b83-9c2d-36192a27b161 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:40.801872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2cfe6-7577-4b83-9c2d-36192a27b161 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:40.805780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aaecf-415e-4b61-b488-d6085bef1b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:40.806464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aaecf-415e-4b61-b488-d6085bef1b82 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:40.806786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aaecf-415e-4b61-b488-d6085bef1b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:40.807064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aaecf-415e-4b61-b488-d6085bef1b82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:40.818262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aaecf-415e-4b61-b488-d6085bef1b82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:40.844367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aaecf-415e-4b61-b488-d6085bef1b82 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:40.862699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-b23aaecf-415e-4b61-b488-d6085bef1b82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:40.863818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 250/500] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:40.869406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83625092-b1dc-494c-b174-b7f924b44649 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:40.878785 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83625092-b1dc-494c-b174-b7f924b44649 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:40.882699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3458bd-5529-4ebf-a307-f082f27a783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:40.883229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3458bd-5529-4ebf-a307-f082f27a783f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:40.883516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3458bd-5529-4ebf-a307-f082f27a783f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:40.883796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3458bd-5529-4ebf-a307-f082f27a783f admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:40.884481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3458bd-5529-4ebf-a307-f082f27a783f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:40.884779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3458bd-5529-4ebf-a307-f082f27a783f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:40.910734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3458bd-5529-4ebf-a307-f082f27a783f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:40.923633 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 251/501] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:40.929147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aaecf-415e-4b61-b488-d6085bef1b82 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:40.938408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aaecf-415e-4b61-b488-d6085bef1b82 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:40.942309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af379-3d4b-4f62-8c84-e17c826976f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:40.943046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af379-3d4b-4f62-8c84-e17c826976f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:40.943329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af379-3d4b-4f62-8c84-e17c826976f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:40.943604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af379-3d4b-4f62-8c84-e17c826976f1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:40.956416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af379-3d4b-4f62-8c84-e17c826976f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:40.982245 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af379-3d4b-4f62-8c84-e17c826976f1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:41.000179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-c80af379-3d4b-4f62-8c84-e17c826976f1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:56:41.001270 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 251/502] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Oct 27 13:56:40 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:41.006849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3458bd-5529-4ebf-a307-f082f27a783f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:41.016936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3458bd-5529-4ebf-a307-f082f27a783f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:41.020922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc5cdd-acbc-4c32-a7e2-2f99b41d9078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:41.021515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5cdd-acbc-4c32-a7e2-2f99b41d9078 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:41.021808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5cdd-acbc-4c32-a7e2-2f99b41d9078 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:41.022093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc5cdd-acbc-4c32-a7e2-2f99b41d9078 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:41.022925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc5cdd-acbc-4c32-a7e2-2f99b41d9078 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:41.023215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc5cdd-acbc-4c32-a7e2-2f99b41d9078 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:41.049551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc5cdd-acbc-4c32-a7e2-2f99b41d9078 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:41.078685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 252/503] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Oct 27 13:56:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:41.084350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af379-3d4b-4f62-8c84-e17c826976f1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:41.094172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af379-3d4b-4f62-8c84-e17c826976f1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:41.098061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ae3f-4eb2-42d7-9720-3d1d9db22bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:41.098810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ae3f-4eb2-42d7-9720-3d1d9db22bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:41.099104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ae3f-4eb2-42d7-9720-3d1d9db22bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:41.099391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00ae3f-4eb2-42d7-9720-3d1d9db22bf7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:41.111966 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00ae3f-4eb2-42d7-9720-3d1d9db22bf7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:41.137644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00ae3f-4eb2-42d7-9720-3d1d9db22bf7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:41.155074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-7b00ae3f-4eb2-42d7-9720-3d1d9db22bf7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:41.156167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 252/504] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:41.161811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc5cdd-acbc-4c32-a7e2-2f99b41d9078 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:41.172727 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc5cdd-acbc-4c32-a7e2-2f99b41d9078 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:41.176672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e62eb-59e2-4c72-b298-fc4b2529b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:41.177249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e62eb-59e2-4c72-b298-fc4b2529b63d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:41.177536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e62eb-59e2-4c72-b298-fc4b2529b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:41.177814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e62eb-59e2-4c72-b298-fc4b2529b63d admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:41.178488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e62eb-59e2-4c72-b298-fc4b2529b63d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:41.178814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e62eb-59e2-4c72-b298-fc4b2529b63d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:41.204824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e62eb-59e2-4c72-b298-fc4b2529b63d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:41.216748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 253/505] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:41.222159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ae3f-4eb2-42d7-9720-3d1d9db22bf7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:41.231261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00ae3f-4eb2-42d7-9720-3d1d9db22bf7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:41.235292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143143b4-2903-4da1-bde8-7823a4b8c4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:41.236257 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143143b4-2903-4da1-bde8-7823a4b8c4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:41.236540 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143143b4-2903-4da1-bde8-7823a4b8c4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:41.236821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143143b4-2903-4da1-bde8-7823a4b8c4b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:41.245562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143143b4-2903-4da1-bde8-7823a4b8c4b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:41.271750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143143b4-2903-4da1-bde8-7823a4b8c4b4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:41.285038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-143143b4-2903-4da1-bde8-7823a4b8c4b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:41.286095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 253/506] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:41.291973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e62eb-59e2-4c72-b298-fc4b2529b63d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:41.301314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e62eb-59e2-4c72-b298-fc4b2529b63d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:41.305276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131a6c-3827-4246-a087-0cbe2b311529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:41.305857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131a6c-3827-4246-a087-0cbe2b311529 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:41.306157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131a6c-3827-4246-a087-0cbe2b311529 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:41.306440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131a6c-3827-4246-a087-0cbe2b311529 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:41.307229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71131a6c-3827-4246-a087-0cbe2b311529 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:41.307532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71131a6c-3827-4246-a087-0cbe2b311529 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:41.334102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71131a6c-3827-4246-a087-0cbe2b311529 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:41.347515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 254/507] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:41.353269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143143b4-2903-4da1-bde8-7823a4b8c4b4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:41.362717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143143b4-2903-4da1-bde8-7823a4b8c4b4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:41.366582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4f57b-f41e-45da-89e5-60bd83ee683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:41.367409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4f57b-f41e-45da-89e5-60bd83ee683a admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:41.367697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4f57b-f41e-45da-89e5-60bd83ee683a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:41.367978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4f57b-f41e-45da-89e5-60bd83ee683a admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/a523c35d222f464e9d4f78ae990e3a17/roles/bc2009b7668f441490dbec4c26f77ba8` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:41.369916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4f57b-f41e-45da-89e5-60bd83ee683a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=a523c35d222f464e9d4f78ae990e3a17, role_id=bc2009b7668f441490dbec4c26f77ba8)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:41.400184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4f57b-f41e-45da-89e5-60bd83ee683a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:41.413042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 254/508] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:56:41 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/a523c35d222f464e9d4f78ae990e3a17/roles/bc2009b7668f441490dbec4c26f77ba8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:56:43.380135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7150e89-db5d-4c02-b3b9-3a5e8c9d806e None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.380675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7150e89-db5d-4c02-b3b9-3a5e8c9d806e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.381090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7150e89-db5d-4c02-b3b9-3a5e8c9d806e None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.384290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 255/509] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:43.389809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662f58e-cad5-46ff-8140-e32026cbfb0e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.390258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662f58e-cad5-46ff-8140-e32026cbfb0e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.390414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662f58e-cad5-46ff-8140-e32026cbfb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.413039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-e662f58e-cad5-46ff-8140-e32026cbfb0e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:43.414170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e662f58e-cad5-46ff-8140-e32026cbfb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:43.482467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 255/510] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:43 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:43.504636 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7150e89-db5d-4c02-b3b9-3a5e8c9d806e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:43.516258 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7150e89-db5d-4c02-b3b9-3a5e8c9d806e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:43.519999 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5808f6-d1cf-44ae-8aca-ef936248cfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:43.520717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5808f6-d1cf-44ae-8aca-ef936248cfed admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.521010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5808f6-d1cf-44ae-8aca-ef936248cfed admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.521288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5808f6-d1cf-44ae-8aca-ef936248cfed admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.532831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5808f6-d1cf-44ae-8aca-ef936248cfed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:43.539470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-0d5808f6-d1cf-44ae-8aca-ef936248cfed admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:56:43.540526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 256/511] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Oct 27 13:56:43 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:43.546597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662f58e-cad5-46ff-8140-e32026cbfb0e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:43.555177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662f58e-cad5-46ff-8140-e32026cbfb0e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:43.559147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d97075-7590-41d7-9b4e-7a8ace004be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:43.559739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d97075-7590-41d7-9b4e-7a8ace004be0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.560027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d97075-7590-41d7-9b4e-7a8ace004be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.560309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d97075-7590-41d7-9b4e-7a8ace004be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.561118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d97075-7590-41d7-9b4e-7a8ace004be0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:43.561422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d97075-7590-41d7-9b4e-7a8ace004be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:43.586370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d97075-7590-41d7-9b4e-7a8ace004be0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:43.595474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 256/512] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Oct 27 13:56:43 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:43.601002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5808f6-d1cf-44ae-8aca-ef936248cfed admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:43.611778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5808f6-d1cf-44ae-8aca-ef936248cfed admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:43.615776 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741ea25-1fe0-4a86-a66b-e027a2b66dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:43.616488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741ea25-1fe0-4a86-a66b-e027a2b66dea admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.616781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741ea25-1fe0-4a86-a66b-e027a2b66dea admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.617065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741ea25-1fe0-4a86-a66b-e027a2b66dea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.628318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741ea25-1fe0-4a86-a66b-e027a2b66dea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:43.653624 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741ea25-1fe0-4a86-a66b-e027a2b66dea admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:43.672219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-1741ea25-1fe0-4a86-a66b-e027a2b66dea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:43.673307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 257/513] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:43.679062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d97075-7590-41d7-9b4e-7a8ace004be0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:43.688331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d97075-7590-41d7-9b4e-7a8ace004be0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:43.692270 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136597f-9204-4bf7-9a64-3ff27e9aef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:43.692856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136597f-9204-4bf7-9a64-3ff27e9aef6b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.693147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136597f-9204-4bf7-9a64-3ff27e9aef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.693431 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136597f-9204-4bf7-9a64-3ff27e9aef6b admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.694113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136597f-9204-4bf7-9a64-3ff27e9aef6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:43.694415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136597f-9204-4bf7-9a64-3ff27e9aef6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:43.720613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136597f-9204-4bf7-9a64-3ff27e9aef6b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:43.735294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 257/514] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:43.741256 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741ea25-1fe0-4a86-a66b-e027a2b66dea admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:43.750903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741ea25-1fe0-4a86-a66b-e027a2b66dea admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:43.754848 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0a277-438f-4bc0-ab7c-e692d188e41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:43.755565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0a277-438f-4bc0-ab7c-e692d188e41a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.755857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0a277-438f-4bc0-ab7c-e692d188e41a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.756143 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0a277-438f-4bc0-ab7c-e692d188e41a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.771261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0a277-438f-4bc0-ab7c-e692d188e41a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:43.800141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0a277-438f-4bc0-ab7c-e692d188e41a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:43.818521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-88c0a277-438f-4bc0-ab7c-e692d188e41a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 13:56:43.819677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 258/515] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Oct 27 13:56:43 2021] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:43.825325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136597f-9204-4bf7-9a64-3ff27e9aef6b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:43.835233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136597f-9204-4bf7-9a64-3ff27e9aef6b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:43.839373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162225f5-71c3-4dfe-9853-e6d2a100b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:43.839965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162225f5-71c3-4dfe-9853-e6d2a100b344 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.840256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162225f5-71c3-4dfe-9853-e6d2a100b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.840541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162225f5-71c3-4dfe-9853-e6d2a100b344 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.841321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162225f5-71c3-4dfe-9853-e6d2a100b344 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:43.841650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162225f5-71c3-4dfe-9853-e6d2a100b344 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:43.868429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162225f5-71c3-4dfe-9853-e6d2a100b344 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:43.898118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 258/516] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Oct 27 13:56:43 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:43.903774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0a277-438f-4bc0-ab7c-e692d188e41a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:43.913681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0a277-438f-4bc0-ab7c-e692d188e41a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:43.917555 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b09db5-fdc0-4dfb-a4ab-3f9f26ffe670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:43.918121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b09db5-fdc0-4dfb-a4ab-3f9f26ffe670 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.918407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b09db5-fdc0-4dfb-a4ab-3f9f26ffe670 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.918723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b09db5-fdc0-4dfb-a4ab-3f9f26ffe670 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.926961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b09db5-fdc0-4dfb-a4ab-3f9f26ffe670 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:43.953267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b09db5-fdc0-4dfb-a4ab-3f9f26ffe670 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:43.961841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 259/517] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:56:43 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:56:43.967976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162225f5-71c3-4dfe-9853-e6d2a100b344 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:43.977284 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162225f5-71c3-4dfe-9853-e6d2a100b344 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:43.981277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86d7d-885c-49bc-8011-ab4187cda634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:43.981996 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86d7d-885c-49bc-8011-ab4187cda634 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:43.982287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86d7d-885c-49bc-8011-ab4187cda634 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:43.982573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86d7d-885c-49bc-8011-ab4187cda634 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:43.994376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca86d7d-885c-49bc-8011-ab4187cda634 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:44.020266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca86d7d-885c-49bc-8011-ab4187cda634 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:44.038349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-eca86d7d-885c-49bc-8011-ab4187cda634 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:44.039496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 259/518] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:44.045226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b09db5-fdc0-4dfb-a4ab-3f9f26ffe670 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:44.053769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b09db5-fdc0-4dfb-a4ab-3f9f26ffe670 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:44.057671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01623-2fb1-4f13-8aef-6e2efc8f6d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:44.058245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01623-2fb1-4f13-8aef-6e2efc8f6d86 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:44.058532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01623-2fb1-4f13-8aef-6e2efc8f6d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:44.058840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01623-2fb1-4f13-8aef-6e2efc8f6d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:44.059515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f01623-2fb1-4f13-8aef-6e2efc8f6d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:44.059809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f01623-2fb1-4f13-8aef-6e2efc8f6d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:44.085466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f01623-2fb1-4f13-8aef-6e2efc8f6d86 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:44.099575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 260/519] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:44.105012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86d7d-885c-49bc-8011-ab4187cda634 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:44.119040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86d7d-885c-49bc-8011-ab4187cda634 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:44.123040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e785b-4880-461a-9a61-fb869d2a68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:44.124642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e785b-4880-461a-9a61-fb869d2a68d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:44.124929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e785b-4880-461a-9a61-fb869d2a68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:44.125211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e785b-4880-461a-9a61-fb869d2a68d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:44.141600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e785b-4880-461a-9a61-fb869d2a68d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:44.167492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e785b-4880-461a-9a61-fb869d2a68d7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:44.181848 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-021e785b-4880-461a-9a61-fb869d2a68d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:44.182965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 260/520] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:44.188756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01623-2fb1-4f13-8aef-6e2efc8f6d86 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:44.198215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01623-2fb1-4f13-8aef-6e2efc8f6d86 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:44.202260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9cbc-f9d7-4874-b8c6-6e90462507cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:44.202879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9cbc-f9d7-4874-b8c6-6e90462507cb admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:44.203176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9cbc-f9d7-4874-b8c6-6e90462507cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:44.203461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9cbc-f9d7-4874-b8c6-6e90462507cb admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:44.204209 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9cbc-f9d7-4874-b8c6-6e90462507cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:44.204511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9cbc-f9d7-4874-b8c6-6e90462507cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:44.230251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9cbc-f9d7-4874-b8c6-6e90462507cb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:44.244250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 261/521] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:44.249973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e785b-4880-461a-9a61-fb869d2a68d7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:44.259470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e785b-4880-461a-9a61-fb869d2a68d7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:44.263453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d403b-2332-430c-bc44-761cd5afdbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:44.264059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d403b-2332-430c-bc44-761cd5afdbbb admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:44.264351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d403b-2332-430c-bc44-761cd5afdbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:44.264632 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d403b-2332-430c-bc44-761cd5afdbbb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:44.265412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d403b-2332-430c-bc44-761cd5afdbbb admin admin] RBAC: Adding query filter params (role.id=bc2009b7668f441490dbec4c26f77ba8, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=a523c35d222f464e9d4f78ae990e3a17) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:44.265720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d403b-2332-430c-bc44-761cd5afdbbb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:44.291392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d403b-2332-430c-bc44-761cd5afdbbb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:44.297782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 261/522] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:56:44 2021] GET /identity/v3/role_assignments?user.id=a523c35d222f464e9d4f78ae990e3a17&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=bc2009b7668f441490dbec4c26f77ba8 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:46.355949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518dcc1-47ef-422e-af15-01e23c7c0bca None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:46.356494 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518dcc1-47ef-422e-af15-01e23c7c0bca None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:46.356585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518dcc1-47ef-422e-af15-01e23c7c0bca None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:46.358406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 262/523] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:46.363712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a73ace-c7ae-4b2b-a66e-92db3b09e850 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:46.364131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a73ace-c7ae-4b2b-a66e-92db3b09e850 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:46.364284 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a73ace-c7ae-4b2b-a66e-92db3b09e850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:46.386640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-64a73ace-c7ae-4b2b-a66e-92db3b09e850 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:46.387804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-64a73ace-c7ae-4b2b-a66e-92db3b09e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:46.395137 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 262/524] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:46 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:46.418064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518dcc1-47ef-422e-af15-01e23c7c0bca None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:46.429934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518dcc1-47ef-422e-af15-01e23c7c0bca None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:46.433802 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85975c-c31d-4e4e-8e88-cea85abb4593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:46.434519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85975c-c31d-4e4e-8e88-cea85abb4593 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:46.434846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85975c-c31d-4e4e-8e88-cea85abb4593 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:46.435134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85975c-c31d-4e4e-8e88-cea85abb4593 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:46.447306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85975c-c31d-4e4e-8e88-cea85abb4593 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:46.473146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85975c-c31d-4e4e-8e88-cea85abb4593 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:46.490227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-dc85975c-c31d-4e4e-8e88-cea85abb4593 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:46.491328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 263/525] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:46.499447 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a73ace-c7ae-4b2b-a66e-92db3b09e850 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:46.508151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a73ace-c7ae-4b2b-a66e-92db3b09e850 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:46.512160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9cadc-f175-47ec-8709-47031bed32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:46.512742 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9cadc-f175-47ec-8709-47031bed32e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:46.513030 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9cadc-f175-47ec-8709-47031bed32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:46.513312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9cadc-f175-47ec-8709-47031bed32e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:46.514818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9cadc-f175-47ec-8709-47031bed32e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:46.515121 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9cadc-f175-47ec-8709-47031bed32e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:46.540247 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9cadc-f175-47ec-8709-47031bed32e1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:46.554731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 263/526] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:46.561177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85975c-c31d-4e4e-8e88-cea85abb4593 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:46.570508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85975c-c31d-4e4e-8e88-cea85abb4593 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:46.574413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da184a7-aabc-4472-94bc-f7134e2935ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:46.575039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da184a7-aabc-4472-94bc-f7134e2935ea admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:46.575329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da184a7-aabc-4472-94bc-f7134e2935ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:46.575614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da184a7-aabc-4472-94bc-f7134e2935ea admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:46.576875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da184a7-aabc-4472-94bc-f7134e2935ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:46.602343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da184a7-aabc-4472-94bc-f7134e2935ea admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:46.624237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 264/527] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:56:46 2021] POST /identity/v3/users => generated 248 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:56:48.602774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf8b8-4a45-4c4b-a00b-f38e2e082d3b None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:48.603305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf8b8-4a45-4c4b-a00b-f38e2e082d3b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:48.603389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf8b8-4a45-4c4b-a00b-f38e2e082d3b None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:48.605014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 264/528] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:48.610226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0397769-baa9-4300-903d-522b729fdf25 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:48.610910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0397769-baa9-4300-903d-522b729fdf25 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:48.611067 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0397769-baa9-4300-903d-522b729fdf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:48.632807 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e0397769-baa9-4300-903d-522b729fdf25 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:48.633932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e0397769-baa9-4300-903d-522b729fdf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:48.641244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 265/529] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:48 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:48.662902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf8b8-4a45-4c4b-a00b-f38e2e082d3b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:48.674342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf8b8-4a45-4c4b-a00b-f38e2e082d3b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:48.678205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ea662-e511-4b13-a738-99b35a425216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:48.678954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ea662-e511-4b13-a738-99b35a425216 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:48.679247 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ea662-e511-4b13-a738-99b35a425216 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:48.679530 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ea662-e511-4b13-a738-99b35a425216 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:48.691102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ea662-e511-4b13-a738-99b35a425216 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:48.697409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-8b5ea662-e511-4b13-a738-99b35a425216 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:56:48.698467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 265/530] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:56:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:56:48.704166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0397769-baa9-4300-903d-522b729fdf25 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:48.712852 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0397769-baa9-4300-903d-522b729fdf25 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:48.717522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e587f0-24cf-41bf-a05b-566695d45569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:48.718454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e587f0-24cf-41bf-a05b-566695d45569 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:48.718920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e587f0-24cf-41bf-a05b-566695d45569 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:48.719355 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e587f0-24cf-41bf-a05b-566695d45569 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:48.720081 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e587f0-24cf-41bf-a05b-566695d45569 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:48.720380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e587f0-24cf-41bf-a05b-566695d45569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:48.746225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e587f0-24cf-41bf-a05b-566695d45569 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:48.755078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 266/531] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:56:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:48.760689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ea662-e511-4b13-a738-99b35a425216 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:48.771357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ea662-e511-4b13-a738-99b35a425216 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:48.775300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87919a9-b243-4a3b-b00a-1558a822193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:48.776008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87919a9-b243-4a3b-b00a-1558a822193f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:48.776300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87919a9-b243-4a3b-b00a-1558a822193f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:48.776588 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87919a9-b243-4a3b-b00a-1558a822193f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:48.788267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87919a9-b243-4a3b-b00a-1558a822193f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:48.814239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87919a9-b243-4a3b-b00a-1558a822193f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:48.832003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e87919a9-b243-4a3b-b00a-1558a822193f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:48.833116 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 266/532] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:48.838787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e587f0-24cf-41bf-a05b-566695d45569 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:48.848614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e587f0-24cf-41bf-a05b-566695d45569 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:48.852567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c6ac3-1661-4a49-b91e-3d78df16c9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:48.853271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c6ac3-1661-4a49-b91e-3d78df16c9ff admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:48.853486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c6ac3-1661-4a49-b91e-3d78df16c9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:48.853771 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c6ac3-1661-4a49-b91e-3d78df16c9ff admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:48.854458 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c6ac3-1661-4a49-b91e-3d78df16c9ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:48.854808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c6ac3-1661-4a49-b91e-3d78df16c9ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:48.880580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c6ac3-1661-4a49-b91e-3d78df16c9ff admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:48.893967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 267/533] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:48.899550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87919a9-b243-4a3b-b00a-1558a822193f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:48.909315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87919a9-b243-4a3b-b00a-1558a822193f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:48.913272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405712-9c61-4cef-8abe-69d0e943693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:48.913988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405712-9c61-4cef-8abe-69d0e943693d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:48.914280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405712-9c61-4cef-8abe-69d0e943693d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:48.914708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405712-9c61-4cef-8abe-69d0e943693d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:48.928563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1405712-9c61-4cef-8abe-69d0e943693d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:48.954035 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1405712-9c61-4cef-8abe-69d0e943693d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:48.972427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-d1405712-9c61-4cef-8abe-69d0e943693d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 13:56:48.973520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 267/534] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:56:48 2021] GET /identity/v3/users/glance => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:48.979066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c6ac3-1661-4a49-b91e-3d78df16c9ff admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:48.989353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c6ac3-1661-4a49-b91e-3d78df16c9ff admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:48.993315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7402754-971c-4a86-beb3-aa98b13f2a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:48.993907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7402754-971c-4a86-beb3-aa98b13f2a70 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:48.994198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7402754-971c-4a86-beb3-aa98b13f2a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:48.994486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7402754-971c-4a86-beb3-aa98b13f2a70 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:48.995298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7402754-971c-4a86-beb3-aa98b13f2a70 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:48.995601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7402754-971c-4a86-beb3-aa98b13f2a70 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:49.021214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7402754-971c-4a86-beb3-aa98b13f2a70 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:49.050455 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 268/535] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Oct 27 13:56:48 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:49.056081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405712-9c61-4cef-8abe-69d0e943693d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:49.065348 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405712-9c61-4cef-8abe-69d0e943693d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:49.069294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210212-17e8-4026-9f8c-045e81b4e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:49.069862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210212-17e8-4026-9f8c-045e81b4e3db admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:49.070150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210212-17e8-4026-9f8c-045e81b4e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:49.070434 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210212-17e8-4026-9f8c-045e81b4e3db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:49.078378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54210212-17e8-4026-9f8c-045e81b4e3db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:49.104274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54210212-17e8-4026-9f8c-045e81b4e3db admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:49.113058 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 268/536] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:56:49 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:56:49.118770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7402754-971c-4a86-beb3-aa98b13f2a70 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:49.128159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7402754-971c-4a86-beb3-aa98b13f2a70 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:49.132106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78949885-4233-47ac-ac8a-a890f6a4b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:49.132814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78949885-4233-47ac-ac8a-a890f6a4b549 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:49.133105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78949885-4233-47ac-ac8a-a890f6a4b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:49.133388 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78949885-4233-47ac-ac8a-a890f6a4b549 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:49.145350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78949885-4233-47ac-ac8a-a890f6a4b549 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:49.171124 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78949885-4233-47ac-ac8a-a890f6a4b549 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:49.188432 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-78949885-4233-47ac-ac8a-a890f6a4b549 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:49.189532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 269/537] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:49.195184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210212-17e8-4026-9f8c-045e81b4e3db admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:49.204172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210212-17e8-4026-9f8c-045e81b4e3db admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:49.208202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9218d-53a7-4e6f-8ad3-e443f5169a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:49.208783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9218d-53a7-4e6f-8ad3-e443f5169a05 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:49.209070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9218d-53a7-4e6f-8ad3-e443f5169a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:49.209352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9218d-53a7-4e6f-8ad3-e443f5169a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:49.210057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9218d-53a7-4e6f-8ad3-e443f5169a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:49.210357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9218d-53a7-4e6f-8ad3-e443f5169a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:49.236899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9218d-53a7-4e6f-8ad3-e443f5169a05 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:49.250391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 269/538] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:56:49.255900 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78949885-4233-47ac-ac8a-a890f6a4b549 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:49.265434 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78949885-4233-47ac-ac8a-a890f6a4b549 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:49.269411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fae9eb-dfcf-43f8-afc9-edc6ce32e410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:49.270114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fae9eb-dfcf-43f8-afc9-edc6ce32e410 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:49.270403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fae9eb-dfcf-43f8-afc9-edc6ce32e410 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:49.270716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fae9eb-dfcf-43f8-afc9-edc6ce32e410 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:49.279888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fae9eb-dfcf-43f8-afc9-edc6ce32e410 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:49.305897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fae9eb-dfcf-43f8-afc9-edc6ce32e410 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:49.320624 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-95fae9eb-dfcf-43f8-afc9-edc6ce32e410 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:49.321729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 270/539] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:49.327665 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9218d-53a7-4e6f-8ad3-e443f5169a05 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:49.337279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9218d-53a7-4e6f-8ad3-e443f5169a05 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:49.341281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c2fb3-5b2f-4aee-b9ac-021ad464da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:49.342074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c2fb3-5b2f-4aee-b9ac-021ad464da4d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:49.342379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c2fb3-5b2f-4aee-b9ac-021ad464da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:49.342700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c2fb3-5b2f-4aee-b9ac-021ad464da4d admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:49.343449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c2fb3-5b2f-4aee-b9ac-021ad464da4d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:49.343757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c2fb3-5b2f-4aee-b9ac-021ad464da4d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:49.369662 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c2fb3-5b2f-4aee-b9ac-021ad464da4d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:49.383204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 270/540] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:49.389099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fae9eb-dfcf-43f8-afc9-edc6ce32e410 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:49.398361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fae9eb-dfcf-43f8-afc9-edc6ce32e410 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:49.402287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31d08f-69b5-4039-bba9-aec19049f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:49.402892 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d08f-69b5-4039-bba9-aec19049f92e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:49.403185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d08f-69b5-4039-bba9-aec19049f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:49.403467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d08f-69b5-4039-bba9-aec19049f92e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:49.404765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d08f-69b5-4039-bba9-aec19049f92e admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=88ddc229d1a0446c83956f9f0c1ddbfc) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:49.405067 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d08f-69b5-4039-bba9-aec19049f92e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:49.431052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d08f-69b5-4039-bba9-aec19049f92e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:49.436798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 271/541] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:56:49 2021] GET /identity/v3/role_assignments?user.id=88ddc229d1a0446c83956f9f0c1ddbfc&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:51.361602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed84dc1-5cce-4b53-bd92-7c313dcb414a None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.362149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed84dc1-5cce-4b53-bd92-7c313dcb414a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.362149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed84dc1-5cce-4b53-bd92-7c313dcb414a None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.363874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 271/542] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:51.369320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9b25-e633-4a86-901b-9c88f067b303 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.369747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9b25-e633-4a86-901b-9c88f067b303 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.369897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9b25-e633-4a86-901b-9c88f067b303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.393169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c3fb9b25-e633-4a86-901b-9c88f067b303 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:51.394303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c3fb9b25-e633-4a86-901b-9c88f067b303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:51.401028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 272/543] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:51 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:51.423164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed84dc1-5cce-4b53-bd92-7c313dcb414a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:51.434826 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed84dc1-5cce-4b53-bd92-7c313dcb414a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:51.439400 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c9781-0c45-4be1-90e6-391e887b4636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:51.440122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c9781-0c45-4be1-90e6-391e887b4636 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.440416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c9781-0c45-4be1-90e6-391e887b4636 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.440703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c9781-0c45-4be1-90e6-391e887b4636 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.452562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c9781-0c45-4be1-90e6-391e887b4636 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:51.458923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-442c9781-0c45-4be1-90e6-391e887b4636 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:56:51.460060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 272/544] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:56:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:51.465994 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb9b25-e633-4a86-901b-9c88f067b303 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:51.474951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb9b25-e633-4a86-901b-9c88f067b303 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:51.478905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d99389-4745-423b-848a-9b8e0b2b3460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:51.479498 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d99389-4745-423b-848a-9b8e0b2b3460 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.479788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d99389-4745-423b-848a-9b8e0b2b3460 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.480072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d99389-4745-423b-848a-9b8e0b2b3460 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.480840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d99389-4745-423b-848a-9b8e0b2b3460 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:51.481081 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d99389-4745-423b-848a-9b8e0b2b3460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:51.507688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d99389-4745-423b-848a-9b8e0b2b3460 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:51.516921 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 273/545] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:56:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:51.522660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c9781-0c45-4be1-90e6-391e887b4636 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:51.532439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c9781-0c45-4be1-90e6-391e887b4636 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:51.536446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a226f-9435-46b6-9fc2-4046ac4adde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:51.537160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a226f-9435-46b6-9fc2-4046ac4adde8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.537448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a226f-9435-46b6-9fc2-4046ac4adde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.537732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a226f-9435-46b6-9fc2-4046ac4adde8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.549413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a226f-9435-46b6-9fc2-4046ac4adde8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:51.575107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a226f-9435-46b6-9fc2-4046ac4adde8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:51.593260 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-191a226f-9435-46b6-9fc2-4046ac4adde8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:51.594369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 273/546] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:51.599990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d99389-4745-423b-848a-9b8e0b2b3460 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:51.609768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d99389-4745-423b-848a-9b8e0b2b3460 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:51.614008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42af03-bd56-49cd-aba9-47bccb0eb1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:51.614539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42af03-bd56-49cd-aba9-47bccb0eb1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.614856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42af03-bd56-49cd-aba9-47bccb0eb1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.615139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42af03-bd56-49cd-aba9-47bccb0eb1f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.615822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42af03-bd56-49cd-aba9-47bccb0eb1f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:51.616119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42af03-bd56-49cd-aba9-47bccb0eb1f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:51.642069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42af03-bd56-49cd-aba9-47bccb0eb1f3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:51.656050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 274/547] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:51.661713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a226f-9435-46b6-9fc2-4046ac4adde8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:51.671808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a226f-9435-46b6-9fc2-4046ac4adde8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:51.675887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c5041-5f82-4211-8bd2-f274ed9bac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:51.676618 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c5041-5f82-4211-8bd2-f274ed9bac31 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.676902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c5041-5f82-4211-8bd2-f274ed9bac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.677181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c5041-5f82-4211-8bd2-f274ed9bac31 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.690887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c5041-5f82-4211-8bd2-f274ed9bac31 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:51.717483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c5041-5f82-4211-8bd2-f274ed9bac31 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:51.736593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-588c5041-5f82-4211-8bd2-f274ed9bac31 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 13:56:51.737697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 274/548] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:56:51 2021] GET /identity/v3/users/glance => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:51.743380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42af03-bd56-49cd-aba9-47bccb0eb1f3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:51.753197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42af03-bd56-49cd-aba9-47bccb0eb1f3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:51.757219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64d95d-2238-490c-9ec9-2423388b077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:51.757806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64d95d-2238-490c-9ec9-2423388b077d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.758100 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64d95d-2238-490c-9ec9-2423388b077d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.758381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64d95d-2238-490c-9ec9-2423388b077d admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.759207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64d95d-2238-490c-9ec9-2423388b077d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:51.759508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64d95d-2238-490c-9ec9-2423388b077d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:51.785270 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64d95d-2238-490c-9ec9-2423388b077d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:51.814911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 275/549] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Oct 27 13:56:51 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:51.820638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c5041-5f82-4211-8bd2-f274ed9bac31 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:51.830004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c5041-5f82-4211-8bd2-f274ed9bac31 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:51.833943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ca800-d881-40d7-a489-c42d44800ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:51.834692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ca800-d881-40d7-a489-c42d44800ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.834985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ca800-d881-40d7-a489-c42d44800ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.835267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ca800-d881-40d7-a489-c42d44800ad4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.848259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ca800-d881-40d7-a489-c42d44800ad4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:51.874495 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ca800-d881-40d7-a489-c42d44800ad4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:51.891578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-af3ca800-d881-40d7-a489-c42d44800ad4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:51.892668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 275/550] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:51.898190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64d95d-2238-490c-9ec9-2423388b077d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:51.908024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64d95d-2238-490c-9ec9-2423388b077d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:51.912041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e496ff-4cb4-48c9-bafb-37ed93b5b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:51.912614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e496ff-4cb4-48c9-bafb-37ed93b5b9ee admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.912903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e496ff-4cb4-48c9-bafb-37ed93b5b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.913182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e496ff-4cb4-48c9-bafb-37ed93b5b9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.913854 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e496ff-4cb4-48c9-bafb-37ed93b5b9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:51.914148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e496ff-4cb4-48c9-bafb-37ed93b5b9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:51.939788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e496ff-4cb4-48c9-bafb-37ed93b5b9ee admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:51.952056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 276/551] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:51.957505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ca800-d881-40d7-a489-c42d44800ad4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:51.967145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ca800-d881-40d7-a489-c42d44800ad4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:51.971185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668f152-9589-4907-9b3b-9bcc6d1df598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:51.971896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668f152-9589-4907-9b3b-9bcc6d1df598 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:51.972184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668f152-9589-4907-9b3b-9bcc6d1df598 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:51.972466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668f152-9589-4907-9b3b-9bcc6d1df598 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:51.983561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668f152-9589-4907-9b3b-9bcc6d1df598 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:52.008811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668f152-9589-4907-9b3b-9bcc6d1df598 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:52.023356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-d668f152-9589-4907-9b3b-9bcc6d1df598 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:52.024437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 276/552] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:52.030561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e496ff-4cb4-48c9-bafb-37ed93b5b9ee admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:52.039843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e496ff-4cb4-48c9-bafb-37ed93b5b9ee admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:52.043760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365974-aceb-44ea-a506-5f56355d8e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:52.044331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365974-aceb-44ea-a506-5f56355d8e1c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:52.044656 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365974-aceb-44ea-a506-5f56355d8e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:52.044947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365974-aceb-44ea-a506-5f56355d8e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:52.045676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365974-aceb-44ea-a506-5f56355d8e1c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:52.045967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365974-aceb-44ea-a506-5f56355d8e1c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:52.071293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365974-aceb-44ea-a506-5f56355d8e1c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:52.084623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 277/553] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:52.090250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668f152-9589-4907-9b3b-9bcc6d1df598 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:52.100092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668f152-9589-4907-9b3b-9bcc6d1df598 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:52.104040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887721d1-296f-40a1-98ac-b372c3a08e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:52.104846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887721d1-296f-40a1-98ac-b372c3a08e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:52.105136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887721d1-296f-40a1-98ac-b372c3a08e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:52.105421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887721d1-296f-40a1-98ac-b372c3a08e10 admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/88ddc229d1a0446c83956f9f0c1ddbfc/roles/18aaf45888374560a4c11e1912d42c97` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:52.125584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887721d1-296f-40a1-98ac-b372c3a08e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=88ddc229d1a0446c83956f9f0c1ddbfc, role_id=18aaf45888374560a4c11e1912d42c97)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:52.151743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887721d1-296f-40a1-98ac-b372c3a08e10 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:52.164729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 277/554] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:56:52 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/88ddc229d1a0446c83956f9f0c1ddbfc/roles/18aaf45888374560a4c11e1912d42c97 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:56:54.125808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc8d74-6b8d-4e6b-8290-55cf9dfd3d73 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.126348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc8d74-6b8d-4e6b-8290-55cf9dfd3d73 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.126436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc8d74-6b8d-4e6b-8290-55cf9dfd3d73 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.128093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 278/555] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:54.133185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d4e6-f9bd-4b30-af12-f3a8710625f3 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.133578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d4e6-f9bd-4b30-af12-f3a8710625f3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.133790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d4e6-f9bd-4b30-af12-f3a8710625f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.156433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8734d4e6-f9bd-4b30-af12-f3a8710625f3 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:54.157581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8734d4e6-f9bd-4b30-af12-f3a8710625f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:54.220607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 278/556] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:54 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:54.242766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc8d74-6b8d-4e6b-8290-55cf9dfd3d73 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.254344 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc8d74-6b8d-4e6b-8290-55cf9dfd3d73 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.258163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf38d9-8b4d-4b42-93f7-260aa136f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.258896 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf38d9-8b4d-4b42-93f7-260aa136f574 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.259185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf38d9-8b4d-4b42-93f7-260aa136f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.259465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf38d9-8b4d-4b42-93f7-260aa136f574 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.271947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf38d9-8b4d-4b42-93f7-260aa136f574 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:54.278172 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-9caf38d9-8b4d-4b42-93f7-260aa136f574 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:56:54.279938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 279/557] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:54.285849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d4e6-f9bd-4b30-af12-f3a8710625f3 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.294382 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d4e6-f9bd-4b30-af12-f3a8710625f3 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.298423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015c244-25d3-4c22-b10f-de0d8cf172bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.299061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015c244-25d3-4c22-b10f-de0d8cf172bd admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.299352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015c244-25d3-4c22-b10f-de0d8cf172bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.299639 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015c244-25d3-4c22-b10f-de0d8cf172bd admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.300353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015c244-25d3-4c22-b10f-de0d8cf172bd admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:54.300694 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015c244-25d3-4c22-b10f-de0d8cf172bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.326301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015c244-25d3-4c22-b10f-de0d8cf172bd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.334758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 279/558] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:54.340237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf38d9-8b4d-4b42-93f7-260aa136f574 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.352712 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf38d9-8b4d-4b42-93f7-260aa136f574 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.356711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ff4ac-3447-4c0f-9c68-f20e96861e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.357492 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ff4ac-3447-4c0f-9c68-f20e96861e0c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.357724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ff4ac-3447-4c0f-9c68-f20e96861e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.358007 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ff4ac-3447-4c0f-9c68-f20e96861e0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.369337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ff4ac-3447-4c0f-9c68-f20e96861e0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.395361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ff4ac-3447-4c0f-9c68-f20e96861e0c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.413512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-8c1ff4ac-3447-4c0f-9c68-f20e96861e0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:54.414581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 280/559] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:54.420295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015c244-25d3-4c22-b10f-de0d8cf172bd admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.429509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015c244-25d3-4c22-b10f-de0d8cf172bd admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.433438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89679d5e-968b-4180-9e28-24764e4e8345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.434022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679d5e-968b-4180-9e28-24764e4e8345 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.434314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679d5e-968b-4180-9e28-24764e4e8345 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.434598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89679d5e-968b-4180-9e28-24764e4e8345 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.435374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89679d5e-968b-4180-9e28-24764e4e8345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:54.435729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89679d5e-968b-4180-9e28-24764e4e8345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.461248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89679d5e-968b-4180-9e28-24764e4e8345 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.474707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 280/560] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:54.480137 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ff4ac-3447-4c0f-9c68-f20e96861e0c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.489914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ff4ac-3447-4c0f-9c68-f20e96861e0c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.493889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3d262-f8da-4148-b6ed-eb858d8d840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.494609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3d262-f8da-4148-b6ed-eb858d8d840c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.494930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3d262-f8da-4148-b6ed-eb858d8d840c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.495218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3d262-f8da-4148-b6ed-eb858d8d840c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.507861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3d262-f8da-4148-b6ed-eb858d8d840c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.533989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3d262-f8da-4148-b6ed-eb858d8d840c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.551895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-59f3d262-f8da-4148-b6ed-eb858d8d840c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 13:56:54.552957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 281/561] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/users/glance => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:54.558443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89679d5e-968b-4180-9e28-24764e4e8345 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.568296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89679d5e-968b-4180-9e28-24764e4e8345 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.572296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6205b-f3a7-4cee-a837-c26bd3d11392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.572885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6205b-f3a7-4cee-a837-c26bd3d11392 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.573172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6205b-f3a7-4cee-a837-c26bd3d11392 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.573455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6205b-f3a7-4cee-a837-c26bd3d11392 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.574228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6205b-f3a7-4cee-a837-c26bd3d11392 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:54.574529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6205b-f3a7-4cee-a837-c26bd3d11392 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.599679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6205b-f3a7-4cee-a837-c26bd3d11392 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.628683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 281/562] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:54.634130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3d262-f8da-4148-b6ed-eb858d8d840c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.645424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3d262-f8da-4148-b6ed-eb858d8d840c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.649408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33129a42-73d2-4df6-b7d3-53bb2f5d1ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.649980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33129a42-73d2-4df6-b7d3-53bb2f5d1ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.650273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33129a42-73d2-4df6-b7d3-53bb2f5d1ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.650557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33129a42-73d2-4df6-b7d3-53bb2f5d1ca2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.659101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33129a42-73d2-4df6-b7d3-53bb2f5d1ca2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.684921 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33129a42-73d2-4df6-b7d3-53bb2f5d1ca2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.693532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 282/563] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:56:54.699112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6205b-f3a7-4cee-a837-c26bd3d11392 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.708351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6205b-f3a7-4cee-a837-c26bd3d11392 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.712271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757885b-d4a1-4d3b-97af-8f2d7e6487d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.712981 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757885b-d4a1-4d3b-97af-8f2d7e6487d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.713268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757885b-d4a1-4d3b-97af-8f2d7e6487d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.713550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757885b-d4a1-4d3b-97af-8f2d7e6487d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.725340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757885b-d4a1-4d3b-97af-8f2d7e6487d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.751014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757885b-d4a1-4d3b-97af-8f2d7e6487d4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.767504 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-5757885b-d4a1-4d3b-97af-8f2d7e6487d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:54.768554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 282/564] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:54.774001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33129a42-73d2-4df6-b7d3-53bb2f5d1ca2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.783211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33129a42-73d2-4df6-b7d3-53bb2f5d1ca2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.787296 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100061a-b778-45aa-b60b-df20fc815e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.787827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100061a-b778-45aa-b60b-df20fc815e29 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.788122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100061a-b778-45aa-b60b-df20fc815e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.788411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100061a-b778-45aa-b60b-df20fc815e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.789093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100061a-b778-45aa-b60b-df20fc815e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:54.789395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100061a-b778-45aa-b60b-df20fc815e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.815490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100061a-b778-45aa-b60b-df20fc815e29 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.829142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 283/565] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:54.834718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757885b-d4a1-4d3b-97af-8f2d7e6487d4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.844823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757885b-d4a1-4d3b-97af-8f2d7e6487d4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.848764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa5d63-ea32-44b1-9f41-974bb45f1b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.849477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa5d63-ea32-44b1-9f41-974bb45f1b55 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.849765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa5d63-ea32-44b1-9f41-974bb45f1b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.850046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa5d63-ea32-44b1-9f41-974bb45f1b55 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.861095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa5d63-ea32-44b1-9f41-974bb45f1b55 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.886633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa5d63-ea32-44b1-9f41-974bb45f1b55 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.900720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-aaaa5d63-ea32-44b1-9f41-974bb45f1b55 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:56:54.901799 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 283/566] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:54.908246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100061a-b778-45aa-b60b-df20fc815e29 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.917545 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100061a-b778-45aa-b60b-df20fc815e29 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.922087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd173922-c1ae-4ceb-be85-8965abc3d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.922700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173922-c1ae-4ceb-be85-8965abc3d364 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.922993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173922-c1ae-4ceb-be85-8965abc3d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.923276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173922-c1ae-4ceb-be85-8965abc3d364 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.924011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd173922-c1ae-4ceb-be85-8965abc3d364 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:54.924314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd173922-c1ae-4ceb-be85-8965abc3d364 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:54.949679 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd173922-c1ae-4ceb-be85-8965abc3d364 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:54.962724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 284/567] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:54.969416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa5d63-ea32-44b1-9f41-974bb45f1b55 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:54.984072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa5d63-ea32-44b1-9f41-974bb45f1b55 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:54.988357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff8baa-c0b4-4aa0-bac0-023dae68cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:54.988938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff8baa-c0b4-4aa0-bac0-023dae68cf9f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:54.989228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff8baa-c0b4-4aa0-bac0-023dae68cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:54.989514 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff8baa-c0b4-4aa0-bac0-023dae68cf9f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:54.990293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff8baa-c0b4-4aa0-bac0-023dae68cf9f admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=88ddc229d1a0446c83956f9f0c1ddbfc) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:54.990600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff8baa-c0b4-4aa0-bac0-023dae68cf9f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:55.017093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff8baa-c0b4-4aa0-bac0-023dae68cf9f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:55.023300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 284/568] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:56:54 2021] GET /identity/v3/role_assignments?user.id=88ddc229d1a0446c83956f9f0c1ddbfc&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:57.059403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957506fa-6861-4722-81f8-28994934440a None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:57.059886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957506fa-6861-4722-81f8-28994934440a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:57.060489 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957506fa-6861-4722-81f8-28994934440a None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:57.062186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 285/569] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:57.067386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8abc-2ea3-4b74-990f-0149bf785bb9 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:57.067813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8abc-2ea3-4b74-990f-0149bf785bb9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:57.067963 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8abc-2ea3-4b74-990f-0149bf785bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:57.090562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-02fc8abc-2ea3-4b74-990f-0149bf785bb9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:57.091900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-02fc8abc-2ea3-4b74-990f-0149bf785bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:57.098645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 285/570] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:57 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:56:57.121732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957506fa-6861-4722-81f8-28994934440a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:57.133760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957506fa-6861-4722-81f8-28994934440a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:57.137492 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fc6c-0bdd-4e5c-9118-c9b9732ea7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:57.138231 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fc6c-0bdd-4e5c-9118-c9b9732ea7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:57.139065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fc6c-0bdd-4e5c-9118-c9b9732ea7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:57.139347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fc6c-0bdd-4e5c-9118-c9b9732ea7f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:57.150725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fc6c-0bdd-4e5c-9118-c9b9732ea7f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:57.176061 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883fc6c-0bdd-4e5c-9118-c9b9732ea7f6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:57.193225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-d883fc6c-0bdd-4e5c-9118-c9b9732ea7f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:57.194300 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 286/571] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:57.200175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8abc-2ea3-4b74-990f-0149bf785bb9 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:57.209349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8abc-2ea3-4b74-990f-0149bf785bb9 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:57.213315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ea02e-1528-49f8-931d-d080ec1b0b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:57.213896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ea02e-1528-49f8-931d-d080ec1b0b77 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:57.214185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ea02e-1528-49f8-931d-d080ec1b0b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:57.214468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ea02e-1528-49f8-931d-d080ec1b0b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:57.215254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ea02e-1528-49f8-931d-d080ec1b0b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:57.215556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ea02e-1528-49f8-931d-d080ec1b0b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:57.241347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ea02e-1528-49f8-931d-d080ec1b0b77 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:57.254640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 286/572] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:57.260223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fc6c-0bdd-4e5c-9118-c9b9732ea7f6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:57.269731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fc6c-0bdd-4e5c-9118-c9b9732ea7f6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:57.273603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3386b5-d361-465e-9e94-f0ba7b1dc092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:57.274184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3386b5-d361-465e-9e94-f0ba7b1dc092 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:57.274470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3386b5-d361-465e-9e94-f0ba7b1dc092 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:57.274778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3386b5-d361-465e-9e94-f0ba7b1dc092 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:57.275420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3386b5-d361-465e-9e94-f0ba7b1dc092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:57.301380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3386b5-d361-465e-9e94-f0ba7b1dc092 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:57.322071 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 287/573] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:56:57 2021] POST /identity/v3/users => generated 254 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:56:59.328234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc79d3b-d735-436f-aa79-2975a734f16b None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.328730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc79d3b-d735-436f-aa79-2975a734f16b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.328730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc79d3b-d735-436f-aa79-2975a734f16b None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.330402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 287/574] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:56:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:56:59.335536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d8e3-6fc2-478a-9331-c0195fd27259 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.335914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d8e3-6fc2-478a-9331-c0195fd27259 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.336110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d8e3-6fc2-478a-9331-c0195fd27259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.357670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-10e4d8e3-6fc2-478a-9331-c0195fd27259 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:56:59.358819 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-10e4d8e3-6fc2-478a-9331-c0195fd27259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:56:59.365683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 288/575] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:56:59 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:56:59.389765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc79d3b-d735-436f-aa79-2975a734f16b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:59.401291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc79d3b-d735-436f-aa79-2975a734f16b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:59.405290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed63b48-0c7b-44e6-a93d-6ef744da4f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:59.406000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed63b48-0c7b-44e6-a93d-6ef744da4f2a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.406294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed63b48-0c7b-44e6-a93d-6ef744da4f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.406580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed63b48-0c7b-44e6-a93d-6ef744da4f2a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.417693 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed63b48-0c7b-44e6-a93d-6ef744da4f2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:56:59.424145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-3ed63b48-0c7b-44e6-a93d-6ef744da4f2a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:56:59.425228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 288/576] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:59.431149 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4d8e3-6fc2-478a-9331-c0195fd27259 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:59.440512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4d8e3-6fc2-478a-9331-c0195fd27259 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:59.444670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a93df-dc74-432a-a951-b38dcc5f4645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:59.445265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a93df-dc74-432a-a951-b38dcc5f4645 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.445556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a93df-dc74-432a-a951-b38dcc5f4645 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.445840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a93df-dc74-432a-a951-b38dcc5f4645 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.446556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a93df-dc74-432a-a951-b38dcc5f4645 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:59.446892 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a93df-dc74-432a-a951-b38dcc5f4645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:59.472953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a93df-dc74-432a-a951-b38dcc5f4645 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:59.482441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 289/577] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:59.488474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed63b48-0c7b-44e6-a93d-6ef744da4f2a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:59.503486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed63b48-0c7b-44e6-a93d-6ef744da4f2a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:59.509215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ed41-d68c-4a52-bc82-8f4f645146d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:59.509928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ed41-d68c-4a52-bc82-8f4f645146d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.510212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ed41-d68c-4a52-bc82-8f4f645146d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.510492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ed41-d68c-4a52-bc82-8f4f645146d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.523103 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3ed41-d68c-4a52-bc82-8f4f645146d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:59.548614 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3ed41-d68c-4a52-bc82-8f4f645146d0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:59.566266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-b5c3ed41-d68c-4a52-bc82-8f4f645146d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:59.567345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 289/578] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:59.572946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a93df-dc74-432a-a951-b38dcc5f4645 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:59.582513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a93df-dc74-432a-a951-b38dcc5f4645 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:59.586433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859929-8947-4030-9cc0-1dfee79b25c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:59.587048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859929-8947-4030-9cc0-1dfee79b25c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.587341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859929-8947-4030-9cc0-1dfee79b25c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.587626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859929-8947-4030-9cc0-1dfee79b25c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.588311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859929-8947-4030-9cc0-1dfee79b25c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:59.588614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859929-8947-4030-9cc0-1dfee79b25c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:59.615144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859929-8947-4030-9cc0-1dfee79b25c2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:59.628792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 290/579] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:59.634352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ed41-d68c-4a52-bc82-8f4f645146d0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:59.643543 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ed41-d68c-4a52-bc82-8f4f645146d0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:59.647563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f05d8-b3c5-4f74-af2f-38b8060ba3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:59.648291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f05d8-b3c5-4f74-af2f-38b8060ba3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.648575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f05d8-b3c5-4f74-af2f-38b8060ba3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.648853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f05d8-b3c5-4f74-af2f-38b8060ba3c8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.661298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f05d8-b3c5-4f74-af2f-38b8060ba3c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:59.687332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f05d8-b3c5-4f74-af2f-38b8060ba3c8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:59.705491 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-9a4f05d8-b3c5-4f74-af2f-38b8060ba3c8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:56:59.706557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 290/580] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:56:59.712198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859929-8947-4030-9cc0-1dfee79b25c2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:59.722255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859929-8947-4030-9cc0-1dfee79b25c2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:59.726258 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acae2-159b-40f9-ad8e-12fd794ac8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:59.726885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acae2-159b-40f9-ad8e-12fd794ac8bb admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.727184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acae2-159b-40f9-ad8e-12fd794ac8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.727469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acae2-159b-40f9-ad8e-12fd794ac8bb admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.728257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153acae2-159b-40f9-ad8e-12fd794ac8bb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:59.728563 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153acae2-159b-40f9-ad8e-12fd794ac8bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:59.754161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153acae2-159b-40f9-ad8e-12fd794ac8bb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:59.783802 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 291/581] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:56:59.789327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f05d8-b3c5-4f74-af2f-38b8060ba3c8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:59.798774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f05d8-b3c5-4f74-af2f-38b8060ba3c8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:59.802769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c096-beb9-4a1b-9f8a-30868aaa9e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:59.803338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c096-beb9-4a1b-9f8a-30868aaa9e61 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.803625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c096-beb9-4a1b-9f8a-30868aaa9e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.803907 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083c096-beb9-4a1b-9f8a-30868aaa9e61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.811765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083c096-beb9-4a1b-9f8a-30868aaa9e61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:59.837917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083c096-beb9-4a1b-9f8a-30868aaa9e61 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:59.848722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 291/582] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:56:59.856930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acae2-159b-40f9-ad8e-12fd794ac8bb admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:59.866784 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acae2-159b-40f9-ad8e-12fd794ac8bb admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:59.870898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215aadf-fe1a-4ec1-912c-43ae3c497677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:59.871613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215aadf-fe1a-4ec1-912c-43ae3c497677 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.871909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215aadf-fe1a-4ec1-912c-43ae3c497677 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.872192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215aadf-fe1a-4ec1-912c-43ae3c497677 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.885289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215aadf-fe1a-4ec1-912c-43ae3c497677 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:59.913877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215aadf-fe1a-4ec1-912c-43ae3c497677 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:59.931739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-a215aadf-fe1a-4ec1-912c-43ae3c497677 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:56:59.932881 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 292/583] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:56:59.939281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c096-beb9-4a1b-9f8a-30868aaa9e61 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:56:59.948206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083c096-beb9-4a1b-9f8a-30868aaa9e61 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:56:59.953168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebef895-2148-4248-a85a-5576b2cd4d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:56:59.953762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef895-2148-4248-a85a-5576b2cd4d17 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:56:59.954052 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef895-2148-4248-a85a-5576b2cd4d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:56:59.954341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef895-2148-4248-a85a-5576b2cd4d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:56:59.955059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebef895-2148-4248-a85a-5576b2cd4d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:56:59.955368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebef895-2148-4248-a85a-5576b2cd4d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:56:59.980571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebef895-2148-4248-a85a-5576b2cd4d17 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:56:59.994175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 292/584] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:00.000502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215aadf-fe1a-4ec1-912c-43ae3c497677 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:00.010245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215aadf-fe1a-4ec1-912c-43ae3c497677 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:00.014875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b82933-a756-49e7-b058-5e4cf9d166ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:00.015589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82933-a756-49e7-b058-5e4cf9d166ae admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:00.015879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82933-a756-49e7-b058-5e4cf9d166ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:00.016162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82933-a756-49e7-b058-5e4cf9d166ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:00.026677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b82933-a756-49e7-b058-5e4cf9d166ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:00.051976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b82933-a756-49e7-b058-5e4cf9d166ae admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:00.066392 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-a5b82933-a756-49e7-b058-5e4cf9d166ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:57:00.067479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 293/585] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:56:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:00.073133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebef895-2148-4248-a85a-5576b2cd4d17 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:00.084635 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebef895-2148-4248-a85a-5576b2cd4d17 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:00.088947 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0199e2-a2a9-4e84-a095-b325e6115ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:00.089473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0199e2-a2a9-4e84-a095-b325e6115ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:00.089767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0199e2-a2a9-4e84-a095-b325e6115ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:00.090048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0199e2-a2a9-4e84-a095-b325e6115ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:00.090825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0199e2-a2a9-4e84-a095-b325e6115ba7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:00.091125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0199e2-a2a9-4e84-a095-b325e6115ba7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:00.116941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0199e2-a2a9-4e84-a095-b325e6115ba7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:00.130890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 293/586] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:57:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:00.136690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b82933-a756-49e7-b058-5e4cf9d166ae admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:00.146717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b82933-a756-49e7-b058-5e4cf9d166ae admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:00.150746 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843954e0-7fd8-488f-be96-f5ca49473538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:00.151320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843954e0-7fd8-488f-be96-f5ca49473538 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:00.151612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843954e0-7fd8-488f-be96-f5ca49473538 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:00.151902 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843954e0-7fd8-488f-be96-f5ca49473538 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:00.152670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843954e0-7fd8-488f-be96-f5ca49473538 admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=4ecd9bf5e6f04ca5a246bcfb7200e34c) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:00.152976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843954e0-7fd8-488f-be96-f5ca49473538 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:00.178200 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843954e0-7fd8-488f-be96-f5ca49473538 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:00.183615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 294/587] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:57:00 2021] GET /identity/v3/role_assignments?user.id=4ecd9bf5e6f04ca5a246bcfb7200e34c&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:02.127658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f80154-b05c-4072-b655-a9667be728ae None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.128171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f80154-b05c-4072-b655-a9667be728ae None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.128288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f80154-b05c-4072-b655-a9667be728ae None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.129892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 294/588] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:02.135051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d511f6-2a6b-4bb5-9d4b-93f4f447383c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.135433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d511f6-2a6b-4bb5-9d4b-93f4f447383c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.135627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d511f6-2a6b-4bb5-9d4b-93f4f447383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.158675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c9d511f6-2a6b-4bb5-9d4b-93f4f447383c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:02.159831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c9d511f6-2a6b-4bb5-9d4b-93f4f447383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:02.166548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 295/589] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:02 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:57:02.188182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f80154-b05c-4072-b655-a9667be728ae None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.199701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f80154-b05c-4072-b655-a9667be728ae None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.204154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec0a7f-e330-4fbf-a587-0d4b8284060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.204870 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec0a7f-e330-4fbf-a587-0d4b8284060d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.205159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec0a7f-e330-4fbf-a587-0d4b8284060d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.205442 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec0a7f-e330-4fbf-a587-0d4b8284060d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.216471 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec0a7f-e330-4fbf-a587-0d4b8284060d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:57:02.222842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-77ec0a7f-e330-4fbf-a587-0d4b8284060d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:57:02.223918 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 295/590] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:02.230015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d511f6-2a6b-4bb5-9d4b-93f4f447383c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.239553 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d511f6-2a6b-4bb5-9d4b-93f4f447383c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.243537 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103858-34d7-4ad9-8cd5-12484c664905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.244126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103858-34d7-4ad9-8cd5-12484c664905 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.244414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103858-34d7-4ad9-8cd5-12484c664905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.244694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103858-34d7-4ad9-8cd5-12484c664905 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.245399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b103858-34d7-4ad9-8cd5-12484c664905 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:02.245695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b103858-34d7-4ad9-8cd5-12484c664905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.272127 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b103858-34d7-4ad9-8cd5-12484c664905 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.280689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 296/591] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:02.286124 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec0a7f-e330-4fbf-a587-0d4b8284060d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.295906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec0a7f-e330-4fbf-a587-0d4b8284060d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.299891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc299ac6-65f3-4ad4-915e-32d9076dad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.300594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc299ac6-65f3-4ad4-915e-32d9076dad26 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.300879 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc299ac6-65f3-4ad4-915e-32d9076dad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.301159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc299ac6-65f3-4ad4-915e-32d9076dad26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.313150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc299ac6-65f3-4ad4-915e-32d9076dad26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.338810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc299ac6-65f3-4ad4-915e-32d9076dad26 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.356049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-cc299ac6-65f3-4ad4-915e-32d9076dad26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:02.357203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 296/592] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:02.363248 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103858-34d7-4ad9-8cd5-12484c664905 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.373379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103858-34d7-4ad9-8cd5-12484c664905 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.377495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37279ae-075a-4d60-8821-e6e538e20610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.378078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37279ae-075a-4d60-8821-e6e538e20610 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.378372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37279ae-075a-4d60-8821-e6e538e20610 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.378715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37279ae-075a-4d60-8821-e6e538e20610 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.379444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37279ae-075a-4d60-8821-e6e538e20610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:02.379745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37279ae-075a-4d60-8821-e6e538e20610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.406369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37279ae-075a-4d60-8821-e6e538e20610 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.420090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 297/593] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:02.425648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc299ac6-65f3-4ad4-915e-32d9076dad26 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.435345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc299ac6-65f3-4ad4-915e-32d9076dad26 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.439358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82907520-5881-4c70-ae68-f4021f43b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.440076 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82907520-5881-4c70-ae68-f4021f43b17a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.440363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82907520-5881-4c70-ae68-f4021f43b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.440645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82907520-5881-4c70-ae68-f4021f43b17a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.453675 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82907520-5881-4c70-ae68-f4021f43b17a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.479044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82907520-5881-4c70-ae68-f4021f43b17a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.498130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-82907520-5881-4c70-ae68-f4021f43b17a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:57:02.499243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 297/594] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:02.505080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37279ae-075a-4d60-8821-e6e538e20610 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.514883 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37279ae-075a-4d60-8821-e6e538e20610 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.518889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fbb41-350e-4411-be70-40f9bb7d491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.519482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fbb41-350e-4411-be70-40f9bb7d491b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.519777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fbb41-350e-4411-be70-40f9bb7d491b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.520064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fbb41-350e-4411-be70-40f9bb7d491b admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.520850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fbb41-350e-4411-be70-40f9bb7d491b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:02.521157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fbb41-350e-4411-be70-40f9bb7d491b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.550868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fbb41-350e-4411-be70-40f9bb7d491b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.581630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 298/595] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:02.587250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82907520-5881-4c70-ae68-f4021f43b17a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.596420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82907520-5881-4c70-ae68-f4021f43b17a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.600321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a174be-8162-486e-bb57-b79c19babbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.601038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a174be-8162-486e-bb57-b79c19babbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.601324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a174be-8162-486e-bb57-b79c19babbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.601604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a174be-8162-486e-bb57-b79c19babbc6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.614388 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a174be-8162-486e-bb57-b79c19babbc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.640858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a174be-8162-486e-bb57-b79c19babbc6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.658185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-30a174be-8162-486e-bb57-b79c19babbc6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:02.659292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 298/596] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:02.664932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fbb41-350e-4411-be70-40f9bb7d491b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.675024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fbb41-350e-4411-be70-40f9bb7d491b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.679013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1249eb-6a72-4587-8815-0bc9a4c15ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.679598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1249eb-6a72-4587-8815-0bc9a4c15ded admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.679892 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1249eb-6a72-4587-8815-0bc9a4c15ded admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.680182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1249eb-6a72-4587-8815-0bc9a4c15ded admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.680860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1249eb-6a72-4587-8815-0bc9a4c15ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:02.681164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1249eb-6a72-4587-8815-0bc9a4c15ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.707048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1249eb-6a72-4587-8815-0bc9a4c15ded admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.719164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 299/597] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:02.724616 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a174be-8162-486e-bb57-b79c19babbc6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.734611 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a174be-8162-486e-bb57-b79c19babbc6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.739295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847258-c5d2-471d-95c0-5c6318269590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.740259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847258-c5d2-471d-95c0-5c6318269590 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.740561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847258-c5d2-471d-95c0-5c6318269590 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.740844 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847258-c5d2-471d-95c0-5c6318269590 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.750797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847258-c5d2-471d-95c0-5c6318269590 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.776068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847258-c5d2-471d-95c0-5c6318269590 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.789720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-28847258-c5d2-471d-95c0-5c6318269590 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:57:02.790822 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 299/598] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:02.797110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1249eb-6a72-4587-8815-0bc9a4c15ded admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.806470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1249eb-6a72-4587-8815-0bc9a4c15ded admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.811339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ddd7b-9a98-4d2a-8b2c-64985fdecf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.811924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ddd7b-9a98-4d2a-8b2c-64985fdecf5a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.812213 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ddd7b-9a98-4d2a-8b2c-64985fdecf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.812496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ddd7b-9a98-4d2a-8b2c-64985fdecf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.813237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ddd7b-9a98-4d2a-8b2c-64985fdecf5a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:02.813541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ddd7b-9a98-4d2a-8b2c-64985fdecf5a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.843991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ddd7b-9a98-4d2a-8b2c-64985fdecf5a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.858438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 300/599] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:57:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:02.864745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847258-c5d2-471d-95c0-5c6318269590 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:02.875337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847258-c5d2-471d-95c0-5c6318269590 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:02.879400 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e9111-f1f8-4d29-97bb-f520d3191081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:02.880402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e9111-f1f8-4d29-97bb-f520d3191081 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:02.880695 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e9111-f1f8-4d29-97bb-f520d3191081 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:02.880978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e9111-f1f8-4d29-97bb-f520d3191081 admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/4ecd9bf5e6f04ca5a246bcfb7200e34c/roles/18aaf45888374560a4c11e1912d42c97` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:02.901898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e9111-f1f8-4d29-97bb-f520d3191081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=4ecd9bf5e6f04ca5a246bcfb7200e34c, role_id=18aaf45888374560a4c11e1912d42c97)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:02.928817 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e9111-f1f8-4d29-97bb-f520d3191081 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:02.942378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 300/600] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:57:02 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/4ecd9bf5e6f04ca5a246bcfb7200e34c/roles/18aaf45888374560a4c11e1912d42c97 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:57:04.900482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c2b5-d4a2-47eb-b0a1-e31067e4ca7b None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:04.901051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c2b5-d4a2-47eb-b0a1-e31067e4ca7b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:04.901051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295c2b5-d4a2-47eb-b0a1-e31067e4ca7b None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:04.902728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 301/601] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:04.908834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbceb1-6c7b-4dcd-9a02-5074c12d9193 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:04.909239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbceb1-6c7b-4dcd-9a02-5074c12d9193 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:04.909413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbceb1-6c7b-4dcd-9a02-5074c12d9193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:04.931427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-20dbceb1-6c7b-4dcd-9a02-5074c12d9193 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:04.932557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-20dbceb1-6c7b-4dcd-9a02-5074c12d9193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:04.999809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 301/602] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:04 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:05.021882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c2b5-d4a2-47eb-b0a1-e31067e4ca7b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.034233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295c2b5-d4a2-47eb-b0a1-e31067e4ca7b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.038024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64b644-3d33-45c9-95b9-c8632e0ffb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.038785 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b644-3d33-45c9-95b9-c8632e0ffb7a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.039078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b644-3d33-45c9-95b9-c8632e0ffb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.039362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64b644-3d33-45c9-95b9-c8632e0ffb7a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.050406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64b644-3d33-45c9-95b9-c8632e0ffb7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:57:05.056783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-0c64b644-3d33-45c9-95b9-c8632e0ffb7a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:57:05.057859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 302/603] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:05.063572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbceb1-6c7b-4dcd-9a02-5074c12d9193 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.071973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbceb1-6c7b-4dcd-9a02-5074c12d9193 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.076649 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990c728-1cd5-4d48-919e-e9b5e4b0d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.077234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990c728-1cd5-4d48-919e-e9b5e4b0d533 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.077519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990c728-1cd5-4d48-919e-e9b5e4b0d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.077797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990c728-1cd5-4d48-919e-e9b5e4b0d533 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.078496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990c728-1cd5-4d48-919e-e9b5e4b0d533 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:05.078814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990c728-1cd5-4d48-919e-e9b5e4b0d533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.104178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990c728-1cd5-4d48-919e-e9b5e4b0d533 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.112823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 302/604] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:05.118864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64b644-3d33-45c9-95b9-c8632e0ffb7a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.129462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64b644-3d33-45c9-95b9-c8632e0ffb7a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.133570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c109659-96cd-4483-a0ec-43417b2edc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.134278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c109659-96cd-4483-a0ec-43417b2edc98 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.134571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c109659-96cd-4483-a0ec-43417b2edc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.134893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c109659-96cd-4483-a0ec-43417b2edc98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.147167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c109659-96cd-4483-a0ec-43417b2edc98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.173423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c109659-96cd-4483-a0ec-43417b2edc98 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.191950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-9c109659-96cd-4483-a0ec-43417b2edc98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:05.193122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 303/605] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:05.198754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990c728-1cd5-4d48-919e-e9b5e4b0d533 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.208549 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990c728-1cd5-4d48-919e-e9b5e4b0d533 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.212642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc8710-e803-4b7d-9cca-fda15ba6d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.213225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc8710-e803-4b7d-9cca-fda15ba6d393 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.213516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc8710-e803-4b7d-9cca-fda15ba6d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.213800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc8710-e803-4b7d-9cca-fda15ba6d393 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.214478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc8710-e803-4b7d-9cca-fda15ba6d393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:05.214810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc8710-e803-4b7d-9cca-fda15ba6d393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.239951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc8710-e803-4b7d-9cca-fda15ba6d393 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.253033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 303/606] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:05.258437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c109659-96cd-4483-a0ec-43417b2edc98 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.268199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c109659-96cd-4483-a0ec-43417b2edc98 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.272181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b375a3-b5d9-4890-b213-892cd2adc194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.272898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b375a3-b5d9-4890-b213-892cd2adc194 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.273185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b375a3-b5d9-4890-b213-892cd2adc194 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.273466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b375a3-b5d9-4890-b213-892cd2adc194 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.286946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b375a3-b5d9-4890-b213-892cd2adc194 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.312796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b375a3-b5d9-4890-b213-892cd2adc194 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.331512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-a0b375a3-b5d9-4890-b213-892cd2adc194 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:57:05.332605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 304/607] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:05.338250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc8710-e803-4b7d-9cca-fda15ba6d393 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.347528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc8710-e803-4b7d-9cca-fda15ba6d393 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.351563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f64bd5-e6ba-4ed0-99ea-eba925989bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.352157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f64bd5-e6ba-4ed0-99ea-eba925989bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.352450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f64bd5-e6ba-4ed0-99ea-eba925989bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.352739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f64bd5-e6ba-4ed0-99ea-eba925989bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.353523 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f64bd5-e6ba-4ed0-99ea-eba925989bc3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:05.353828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f64bd5-e6ba-4ed0-99ea-eba925989bc3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.382203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f64bd5-e6ba-4ed0-99ea-eba925989bc3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.411413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 304/608] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:05.416987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b375a3-b5d9-4890-b213-892cd2adc194 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.426744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b375a3-b5d9-4890-b213-892cd2adc194 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.431417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d30f47-9c7c-4b3c-964a-7cdc3666802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.431417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30f47-9c7c-4b3c-964a-7cdc3666802a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.431638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30f47-9c7c-4b3c-964a-7cdc3666802a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.431728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30f47-9c7c-4b3c-964a-7cdc3666802a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.439757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d30f47-9c7c-4b3c-964a-7cdc3666802a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.465601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d30f47-9c7c-4b3c-964a-7cdc3666802a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.474930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 305/609] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:57:05.480672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f64bd5-e6ba-4ed0-99ea-eba925989bc3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.490859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f64bd5-e6ba-4ed0-99ea-eba925989bc3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.494862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02e029-fd16-4190-aa28-1a6c1169bd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.495580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02e029-fd16-4190-aa28-1a6c1169bd0b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.495874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02e029-fd16-4190-aa28-1a6c1169bd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.496162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02e029-fd16-4190-aa28-1a6c1169bd0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.509363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02e029-fd16-4190-aa28-1a6c1169bd0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.535031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02e029-fd16-4190-aa28-1a6c1169bd0b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.552702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-1a02e029-fd16-4190-aa28-1a6c1169bd0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:05.553796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 305/610] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:05.559346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d30f47-9c7c-4b3c-964a-7cdc3666802a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.568629 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d30f47-9c7c-4b3c-964a-7cdc3666802a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.572635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421bdf3-b096-43c7-a112-c2caf2b960dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.573217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421bdf3-b096-43c7-a112-c2caf2b960dd admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.573504 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421bdf3-b096-43c7-a112-c2caf2b960dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.573787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421bdf3-b096-43c7-a112-c2caf2b960dd admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.574465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421bdf3-b096-43c7-a112-c2caf2b960dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:05.574798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421bdf3-b096-43c7-a112-c2caf2b960dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.599832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421bdf3-b096-43c7-a112-c2caf2b960dd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.613468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 306/611] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:05.618864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02e029-fd16-4190-aa28-1a6c1169bd0b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.628974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02e029-fd16-4190-aa28-1a6c1169bd0b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.632979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dae776-4396-46c9-8b66-f088d999efc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.633689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dae776-4396-46c9-8b66-f088d999efc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.633982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dae776-4396-46c9-8b66-f088d999efc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.634266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dae776-4396-46c9-8b66-f088d999efc5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.643148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dae776-4396-46c9-8b66-f088d999efc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.668353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dae776-4396-46c9-8b66-f088d999efc5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.682166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-77dae776-4396-46c9-8b66-f088d999efc5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:57:05.683291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 306/612] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:05.689596 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421bdf3-b096-43c7-a112-c2caf2b960dd admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.698836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421bdf3-b096-43c7-a112-c2caf2b960dd admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.703795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed9c5b-4afa-4ab6-811c-b24a96fff30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.704395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed9c5b-4afa-4ab6-811c-b24a96fff30f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.704691 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed9c5b-4afa-4ab6-811c-b24a96fff30f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.704981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed9c5b-4afa-4ab6-811c-b24a96fff30f admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.705721 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed9c5b-4afa-4ab6-811c-b24a96fff30f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:05.706031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed9c5b-4afa-4ab6-811c-b24a96fff30f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.731225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed9c5b-4afa-4ab6-811c-b24a96fff30f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.745156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 307/613] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:05.751506 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dae776-4396-46c9-8b66-f088d999efc5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:05.760659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dae776-4396-46c9-8b66-f088d999efc5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:05.764737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9e103-2c1a-43a5-bcd4-26fcd00bf55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:05.765312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e103-2c1a-43a5-bcd4-26fcd00bf55d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:05.765604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e103-2c1a-43a5-bcd4-26fcd00bf55d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:05.765893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e103-2c1a-43a5-bcd4-26fcd00bf55d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:05.766693 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e103-2c1a-43a5-bcd4-26fcd00bf55d admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=4ecd9bf5e6f04ca5a246bcfb7200e34c) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:05.767006 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e103-2c1a-43a5-bcd4-26fcd00bf55d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:05.792349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e103-2c1a-43a5-bcd4-26fcd00bf55d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:05.799231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 307/614] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:57:05 2021] GET /identity/v3/role_assignments?user.id=4ecd9bf5e6f04ca5a246bcfb7200e34c&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:07.815017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa37ea-9417-4d36-9681-0b0ef23b399d None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:07.815559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa37ea-9417-4d36-9681-0b0ef23b399d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:07.815667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa37ea-9417-4d36-9681-0b0ef23b399d None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:07.817258 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 308/615] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:07.822421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebeafb-a3e0-489b-923b-a2733609086b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:07.822888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebeafb-a3e0-489b-923b-a2733609086b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:07.823036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebeafb-a3e0-489b-923b-a2733609086b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:07.846826 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-62ebeafb-a3e0-489b-923b-a2733609086b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:07.848014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-62ebeafb-a3e0-489b-923b-a2733609086b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:07.854729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 308/616] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:07 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:07.876968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa37ea-9417-4d36-9681-0b0ef23b399d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:07.889152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa37ea-9417-4d36-9681-0b0ef23b399d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:07.893022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4c62-02cf-48dc-a7fa-e90df4e7d4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:07.893742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4c62-02cf-48dc-a7fa-e90df4e7d4ae admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:07.894093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4c62-02cf-48dc-a7fa-e90df4e7d4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:07.894306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4c62-02cf-48dc-a7fa-e90df4e7d4ae admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:07.905897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba4c62-02cf-48dc-a7fa-e90df4e7d4ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:57:07.912551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-58ba4c62-02cf-48dc-a7fa-e90df4e7d4ae admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:57:07.913630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 309/617] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Oct 27 13:57:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:07.919468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebeafb-a3e0-489b-923b-a2733609086b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:07.928170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebeafb-a3e0-489b-923b-a2733609086b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:07.933847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068827f-97e5-43d9-b080-e05b6aa91453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:07.934447 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068827f-97e5-43d9-b080-e05b6aa91453 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:07.934776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068827f-97e5-43d9-b080-e05b6aa91453 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:07.935065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068827f-97e5-43d9-b080-e05b6aa91453 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:07.935773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068827f-97e5-43d9-b080-e05b6aa91453 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:07.936068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068827f-97e5-43d9-b080-e05b6aa91453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:07.961859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068827f-97e5-43d9-b080-e05b6aa91453 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:07.971655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 309/618] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Oct 27 13:57:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:07.977357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4c62-02cf-48dc-a7fa-e90df4e7d4ae admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:07.987656 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4c62-02cf-48dc-a7fa-e90df4e7d4ae admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:07.991743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e21b85-9f38-47bf-acb7-5408e02cb08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:07.992454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e21b85-9f38-47bf-acb7-5408e02cb08d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:07.992747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e21b85-9f38-47bf-acb7-5408e02cb08d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:07.993035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e21b85-9f38-47bf-acb7-5408e02cb08d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.004541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e21b85-9f38-47bf-acb7-5408e02cb08d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.031711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e21b85-9f38-47bf-acb7-5408e02cb08d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.051182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-66e21b85-9f38-47bf-acb7-5408e02cb08d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:08.052270 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 310/619] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:08.058116 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068827f-97e5-43d9-b080-e05b6aa91453 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:08.068191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068827f-97e5-43d9-b080-e05b6aa91453 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:08.072162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0b9b-b59f-4e98-9806-b97f0862e504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:08.072756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0b9b-b59f-4e98-9806-b97f0862e504 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:08.073049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0b9b-b59f-4e98-9806-b97f0862e504 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:08.073337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0b9b-b59f-4e98-9806-b97f0862e504 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.074017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db0b9b-b59f-4e98-9806-b97f0862e504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:08.074321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db0b9b-b59f-4e98-9806-b97f0862e504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.100520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db0b9b-b59f-4e98-9806-b97f0862e504 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.113778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 310/620] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:08.119380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e21b85-9f38-47bf-acb7-5408e02cb08d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:08.129027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e21b85-9f38-47bf-acb7-5408e02cb08d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:08.132954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d87cbc-d82d-4ef2-a1f8-228d214deb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:08.133675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d87cbc-d82d-4ef2-a1f8-228d214deb56 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:08.133963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d87cbc-d82d-4ef2-a1f8-228d214deb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:08.134243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d87cbc-d82d-4ef2-a1f8-228d214deb56 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.147204 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d87cbc-d82d-4ef2-a1f8-228d214deb56 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.172394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d87cbc-d82d-4ef2-a1f8-228d214deb56 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.190548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-a4d87cbc-d82d-4ef2-a1f8-228d214deb56 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:57:08.191623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 311/621] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 13:57:08 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:08.197249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0b9b-b59f-4e98-9806-b97f0862e504 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:08.207126 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0b9b-b59f-4e98-9806-b97f0862e504 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:08.211327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb371d-782f-4201-b066-71bc1d08d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:08.211923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb371d-782f-4201-b066-71bc1d08d5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:08.212214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb371d-782f-4201-b066-71bc1d08d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:08.212502 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb371d-782f-4201-b066-71bc1d08d5d8 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.213287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb371d-782f-4201-b066-71bc1d08d5d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:08.213593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb371d-782f-4201-b066-71bc1d08d5d8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.239058 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb371d-782f-4201-b066-71bc1d08d5d8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.268772 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 311/622] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Oct 27 13:57:08 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:08.274335 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d87cbc-d82d-4ef2-a1f8-228d214deb56 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:08.283949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d87cbc-d82d-4ef2-a1f8-228d214deb56 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:08.288154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737e0fc-440a-41ed-94f5-589a87fedbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:08.288891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737e0fc-440a-41ed-94f5-589a87fedbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:08.289182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737e0fc-440a-41ed-94f5-589a87fedbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:08.289459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737e0fc-440a-41ed-94f5-589a87fedbf3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.298276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737e0fc-440a-41ed-94f5-589a87fedbf3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.324741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737e0fc-440a-41ed-94f5-589a87fedbf3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.335471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 312/623] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:57:08 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:57:08.341646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb371d-782f-4201-b066-71bc1d08d5d8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:08.351641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb371d-782f-4201-b066-71bc1d08d5d8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:08.355664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a662db-0664-406c-89b5-59010870bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:08.356376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a662db-0664-406c-89b5-59010870bf25 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:08.356799 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a662db-0664-406c-89b5-59010870bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:08.357138 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a662db-0664-406c-89b5-59010870bf25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.368783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a662db-0664-406c-89b5-59010870bf25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.395492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a662db-0664-406c-89b5-59010870bf25 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.412339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-20a662db-0664-406c-89b5-59010870bf25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:08.413436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 312/624] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:08.420142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737e0fc-440a-41ed-94f5-589a87fedbf3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:08.428844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737e0fc-440a-41ed-94f5-589a87fedbf3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:08.432925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e38e16-6ea9-4a84-8f34-20f67a4cb19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:08.433500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e38e16-6ea9-4a84-8f34-20f67a4cb19e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:08.433793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e38e16-6ea9-4a84-8f34-20f67a4cb19e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:08.434076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e38e16-6ea9-4a84-8f34-20f67a4cb19e admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.435378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e38e16-6ea9-4a84-8f34-20f67a4cb19e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:08.435711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e38e16-6ea9-4a84-8f34-20f67a4cb19e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.461690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e38e16-6ea9-4a84-8f34-20f67a4cb19e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.474901 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 313/625] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:08.480407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a662db-0664-406c-89b5-59010870bf25 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:08.490744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a662db-0664-406c-89b5-59010870bf25 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:08.494698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594143-56e8-44e0-97d7-a9331cbc49ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:08.495406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594143-56e8-44e0-97d7-a9331cbc49ff admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:08.495694 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594143-56e8-44e0-97d7-a9331cbc49ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:08.495974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594143-56e8-44e0-97d7-a9331cbc49ff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.507191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594143-56e8-44e0-97d7-a9331cbc49ff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.532955 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594143-56e8-44e0-97d7-a9331cbc49ff admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.547150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-fd594143-56e8-44e0-97d7-a9331cbc49ff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:57:08.548222 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 313/626] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:57:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:08.553911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e38e16-6ea9-4a84-8f34-20f67a4cb19e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:08.563970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e38e16-6ea9-4a84-8f34-20f67a4cb19e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:08.567927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7b394-1371-4728-8bc8-9457b5e2483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:08.568505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7b394-1371-4728-8bc8-9457b5e2483e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:08.568797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7b394-1371-4728-8bc8-9457b5e2483e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:08.569083 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7b394-1371-4728-8bc8-9457b5e2483e admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.569821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7b394-1371-4728-8bc8-9457b5e2483e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:08.570120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7b394-1371-4728-8bc8-9457b5e2483e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.595953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7b394-1371-4728-8bc8-9457b5e2483e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.609877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 314/627] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:57:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:08.615863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594143-56e8-44e0-97d7-a9331cbc49ff admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:08.625643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594143-56e8-44e0-97d7-a9331cbc49ff admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:08.629579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da5788-7b83-47c7-90f4-9e0439be3b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:08.630157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da5788-7b83-47c7-90f4-9e0439be3b75 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:08.630453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da5788-7b83-47c7-90f4-9e0439be3b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:08.630774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da5788-7b83-47c7-90f4-9e0439be3b75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:08.631553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da5788-7b83-47c7-90f4-9e0439be3b75 admin admin] RBAC: Adding query filter params (role.id=bc2009b7668f441490dbec4c26f77ba8, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=4ecd9bf5e6f04ca5a246bcfb7200e34c) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:08.631861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da5788-7b83-47c7-90f4-9e0439be3b75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:08.657678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da5788-7b83-47c7-90f4-9e0439be3b75 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:08.663084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 314/628] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:57:08 2021] GET /identity/v3/role_assignments?user.id=4ecd9bf5e6f04ca5a246bcfb7200e34c&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=bc2009b7668f441490dbec4c26f77ba8 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:10.591554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171967e-cef7-4c05-982a-7704c5674f6e None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:10.592107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171967e-cef7-4c05-982a-7704c5674f6e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:10.592107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171967e-cef7-4c05-982a-7704c5674f6e None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:10.593772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 315/629] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:10.599154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5b620-0b64-4915-81eb-e9294a9c399b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:10.599576 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5b620-0b64-4915-81eb-e9294a9c399b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:10.599732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5b620-0b64-4915-81eb-e9294a9c399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:10.622652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-59f5b620-0b64-4915-81eb-e9294a9c399b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:10.623797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-59f5b620-0b64-4915-81eb-e9294a9c399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:10.630328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 315/630] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:10 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:10.652154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171967e-cef7-4c05-982a-7704c5674f6e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:10.663924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171967e-cef7-4c05-982a-7704c5674f6e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:10.667804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a094-ef66-418a-849d-f48070e1848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:10.668529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a094-ef66-418a-849d-f48070e1848d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:10.668824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a094-ef66-418a-849d-f48070e1848d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:10.669153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a094-ef66-418a-849d-f48070e1848d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:10.680297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964a094-ef66-418a-849d-f48070e1848d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:57:10.687513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-1964a094-ef66-418a-849d-f48070e1848d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:57:10.688593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 316/631] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Oct 27 13:57:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:10.694348 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5b620-0b64-4915-81eb-e9294a9c399b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:10.703616 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5b620-0b64-4915-81eb-e9294a9c399b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:10.707641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbffdd0-0ed8-41ef-ae21-be5b1f9dc937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:10.708230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbffdd0-0ed8-41ef-ae21-be5b1f9dc937 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:10.708516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbffdd0-0ed8-41ef-ae21-be5b1f9dc937 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:10.708797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbffdd0-0ed8-41ef-ae21-be5b1f9dc937 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:10.709509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbffdd0-0ed8-41ef-ae21-be5b1f9dc937 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:10.709808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbffdd0-0ed8-41ef-ae21-be5b1f9dc937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:10.735782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbffdd0-0ed8-41ef-ae21-be5b1f9dc937 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:10.744258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 316/632] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Oct 27 13:57:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:10.750727 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a094-ef66-418a-849d-f48070e1848d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:10.760434 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a094-ef66-418a-849d-f48070e1848d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:10.764845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49184c-b08d-420e-b805-2169b2ca188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:10.765548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49184c-b08d-420e-b805-2169b2ca188f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:10.765840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49184c-b08d-420e-b805-2169b2ca188f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:10.766123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49184c-b08d-420e-b805-2169b2ca188f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:10.777289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49184c-b08d-420e-b805-2169b2ca188f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:10.803676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49184c-b08d-420e-b805-2169b2ca188f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:10.822208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-eb49184c-b08d-420e-b805-2169b2ca188f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:10.823352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 317/633] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:10.830443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbffdd0-0ed8-41ef-ae21-be5b1f9dc937 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:10.840453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbffdd0-0ed8-41ef-ae21-be5b1f9dc937 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:10.844828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cec75-d151-4e32-8cad-f07df58f7f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:10.845417 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cec75-d151-4e32-8cad-f07df58f7f72 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:10.845716 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cec75-d151-4e32-8cad-f07df58f7f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:10.846002 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cec75-d151-4e32-8cad-f07df58f7f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:10.846725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cec75-d151-4e32-8cad-f07df58f7f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:10.847029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cec75-d151-4e32-8cad-f07df58f7f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:10.873477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cec75-d151-4e32-8cad-f07df58f7f72 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:10.886641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 317/634] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:10.892569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49184c-b08d-420e-b805-2169b2ca188f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:10.901811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49184c-b08d-420e-b805-2169b2ca188f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:10.906358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb498e6-76e5-48e8-a47f-f6fb29b4d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:10.907111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb498e6-76e5-48e8-a47f-f6fb29b4d412 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:10.907398 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb498e6-76e5-48e8-a47f-f6fb29b4d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:10.907678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb498e6-76e5-48e8-a47f-f6fb29b4d412 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:10.920609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb498e6-76e5-48e8-a47f-f6fb29b4d412 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:10.946581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb498e6-76e5-48e8-a47f-f6fb29b4d412 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:10.964364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-feb498e6-76e5-48e8-a47f-f6fb29b4d412 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:57:10.965472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 318/635] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 13:57:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:10.971118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cec75-d151-4e32-8cad-f07df58f7f72 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:10.980516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cec75-d151-4e32-8cad-f07df58f7f72 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:10.985155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b6869-a852-4380-9715-90ec4530d746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:10.986080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b6869-a852-4380-9715-90ec4530d746 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:10.986456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b6869-a852-4380-9715-90ec4530d746 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:10.986835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b6869-a852-4380-9715-90ec4530d746 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:10.987699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b6869-a852-4380-9715-90ec4530d746 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:10.988074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b6869-a852-4380-9715-90ec4530d746 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:11.014273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b6869-a852-4380-9715-90ec4530d746 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:11.042950 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 318/636] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Oct 27 13:57:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:11.048987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb498e6-76e5-48e8-a47f-f6fb29b4d412 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:11.058304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb498e6-76e5-48e8-a47f-f6fb29b4d412 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:11.063020 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01389377-4197-4a8c-8b9a-1c03319588f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:11.063743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01389377-4197-4a8c-8b9a-1c03319588f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:11.064034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01389377-4197-4a8c-8b9a-1c03319588f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:11.064322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01389377-4197-4a8c-8b9a-1c03319588f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:11.077286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01389377-4197-4a8c-8b9a-1c03319588f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:11.102495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01389377-4197-4a8c-8b9a-1c03319588f6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:11.119972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-01389377-4197-4a8c-8b9a-1c03319588f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:11.121046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 319/637] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:11.127375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b6869-a852-4380-9715-90ec4530d746 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:11.136553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b6869-a852-4380-9715-90ec4530d746 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:11.140638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a83f0e-6796-4ac3-8695-07eaee611897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:11.141221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a83f0e-6796-4ac3-8695-07eaee611897 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:11.141510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a83f0e-6796-4ac3-8695-07eaee611897 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:11.141794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a83f0e-6796-4ac3-8695-07eaee611897 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:11.142469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a83f0e-6796-4ac3-8695-07eaee611897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:11.142804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a83f0e-6796-4ac3-8695-07eaee611897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:11.168445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a83f0e-6796-4ac3-8695-07eaee611897 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:11.181739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 319/638] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:11.187491 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01389377-4197-4a8c-8b9a-1c03319588f6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:11.196789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01389377-4197-4a8c-8b9a-1c03319588f6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:11.200794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dedefd-f34f-4dc5-9c35-4e0bca84f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:11.201499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dedefd-f34f-4dc5-9c35-4e0bca84f223 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:11.201791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dedefd-f34f-4dc5-9c35-4e0bca84f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:11.202075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dedefd-f34f-4dc5-9c35-4e0bca84f223 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:11.210939 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dedefd-f34f-4dc5-9c35-4e0bca84f223 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:11.237795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dedefd-f34f-4dc5-9c35-4e0bca84f223 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:11.251554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-d8dedefd-f34f-4dc5-9c35-4e0bca84f223 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:57:11.252613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 320/639] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:57:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:11.258229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a83f0e-6796-4ac3-8695-07eaee611897 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:11.267404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a83f0e-6796-4ac3-8695-07eaee611897 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:11.271385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb17d-7125-4379-8e64-52e15e73f73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:11.271961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb17d-7125-4379-8e64-52e15e73f73f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:11.272248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb17d-7125-4379-8e64-52e15e73f73f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:11.272528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb17d-7125-4379-8e64-52e15e73f73f admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:11.273260 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeb17d-7125-4379-8e64-52e15e73f73f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:11.273561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeb17d-7125-4379-8e64-52e15e73f73f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:11.299721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeb17d-7125-4379-8e64-52e15e73f73f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:11.312857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 320/640] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:57:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:11.318673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dedefd-f34f-4dc5-9c35-4e0bca84f223 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:11.328324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dedefd-f34f-4dc5-9c35-4e0bca84f223 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:11.332329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695258a-90d8-45cc-b499-1685c0fb3156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:11.333132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695258a-90d8-45cc-b499-1685c0fb3156 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:11.333422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695258a-90d8-45cc-b499-1685c0fb3156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:11.333703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695258a-90d8-45cc-b499-1685c0fb3156 admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/4ecd9bf5e6f04ca5a246bcfb7200e34c/roles/bc2009b7668f441490dbec4c26f77ba8` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:11.335812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695258a-90d8-45cc-b499-1685c0fb3156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=4ecd9bf5e6f04ca5a246bcfb7200e34c, role_id=bc2009b7668f441490dbec4c26f77ba8)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:11.364114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695258a-90d8-45cc-b499-1685c0fb3156 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:11.376451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 321/641] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:57:11 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/4ecd9bf5e6f04ca5a246bcfb7200e34c/roles/bc2009b7668f441490dbec4c26f77ba8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:57:13.332610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fecbe6-fbed-424a-993e-dff1f828829e None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.333108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fecbe6-fbed-424a-993e-dff1f828829e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.333108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fecbe6-fbed-424a-993e-dff1f828829e None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.334761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 321/642] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:13.339742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92b1e2-146e-4bcd-a613-456a6558e824 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.340161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92b1e2-146e-4bcd-a613-456a6558e824 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.340309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92b1e2-146e-4bcd-a613-456a6558e824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.363502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-1b92b1e2-146e-4bcd-a613-456a6558e824 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:13.364627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1b92b1e2-146e-4bcd-a613-456a6558e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:13.428048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 322/643] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:13 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:13.449858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fecbe6-fbed-424a-993e-dff1f828829e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:13.461396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fecbe6-fbed-424a-993e-dff1f828829e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:13.465341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093a14e-0e5b-4bf8-ad35-231002c5ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:13.466615 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093a14e-0e5b-4bf8-ad35-231002c5ba0f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.466930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093a14e-0e5b-4bf8-ad35-231002c5ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.467218 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093a14e-0e5b-4bf8-ad35-231002c5ba0f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.478194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093a14e-0e5b-4bf8-ad35-231002c5ba0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:57:13.485772 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-9093a14e-0e5b-4bf8-ad35-231002c5ba0f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 13:57:13.486882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 322/644] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Oct 27 13:57:13 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:13.492592 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92b1e2-146e-4bcd-a613-456a6558e824 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:13.501120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92b1e2-146e-4bcd-a613-456a6558e824 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:13.505053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57e1e0-2d9b-4e17-a515-f03f5036316b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:13.505640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57e1e0-2d9b-4e17-a515-f03f5036316b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.505926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57e1e0-2d9b-4e17-a515-f03f5036316b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.506206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57e1e0-2d9b-4e17-a515-f03f5036316b admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.506937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57e1e0-2d9b-4e17-a515-f03f5036316b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:13.507237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57e1e0-2d9b-4e17-a515-f03f5036316b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:13.532515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57e1e0-2d9b-4e17-a515-f03f5036316b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:13.541011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 323/645] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Oct 27 13:57:13 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:13.547049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093a14e-0e5b-4bf8-ad35-231002c5ba0f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:13.556713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093a14e-0e5b-4bf8-ad35-231002c5ba0f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:13.561420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3c6d9-7fd7-41b6-bf1c-22bc43160730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:13.562130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3c6d9-7fd7-41b6-bf1c-22bc43160730 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.562423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3c6d9-7fd7-41b6-bf1c-22bc43160730 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.562733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3c6d9-7fd7-41b6-bf1c-22bc43160730 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.573644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3c6d9-7fd7-41b6-bf1c-22bc43160730 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:13.599850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3c6d9-7fd7-41b6-bf1c-22bc43160730 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:13.618033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-01f3c6d9-7fd7-41b6-bf1c-22bc43160730 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:13.619156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 323/646] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:13.625678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57e1e0-2d9b-4e17-a515-f03f5036316b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:13.635022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57e1e0-2d9b-4e17-a515-f03f5036316b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:13.645601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8865a-599f-4551-be39-c0681d1d3c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:13.645601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8865a-599f-4551-be39-c0681d1d3c28 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.645601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8865a-599f-4551-be39-c0681d1d3c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.645601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8865a-599f-4551-be39-c0681d1d3c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.646003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8865a-599f-4551-be39-c0681d1d3c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:13.646003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8865a-599f-4551-be39-c0681d1d3c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:13.670070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8865a-599f-4551-be39-c0681d1d3c28 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:13.684979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 324/647] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:13.690564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3c6d9-7fd7-41b6-bf1c-22bc43160730 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:13.699990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3c6d9-7fd7-41b6-bf1c-22bc43160730 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:13.705287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3a608-435f-49c0-9573-686c290fd866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:13.706031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3a608-435f-49c0-9573-686c290fd866 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.706324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3a608-435f-49c0-9573-686c290fd866 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.706617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3a608-435f-49c0-9573-686c290fd866 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.719536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3a608-435f-49c0-9573-686c290fd866 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:13.745728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3a608-435f-49c0-9573-686c290fd866 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:13.764137 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-02b3a608-435f-49c0-9573-686c290fd866 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 13:57:13.765203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 324/648] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 13:57:13 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:13.770910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8865a-599f-4551-be39-c0681d1d3c28 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:13.780663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8865a-599f-4551-be39-c0681d1d3c28 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:13.784713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a402524-9ebd-4310-9aec-c64a0432b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:13.785300 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a402524-9ebd-4310-9aec-c64a0432b9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.785592 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a402524-9ebd-4310-9aec-c64a0432b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.785877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a402524-9ebd-4310-9aec-c64a0432b9a7 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.786697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a402524-9ebd-4310-9aec-c64a0432b9a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:13.787006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a402524-9ebd-4310-9aec-c64a0432b9a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:13.813541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a402524-9ebd-4310-9aec-c64a0432b9a7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:13.843009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 325/649] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Oct 27 13:57:13 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:13.848591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3a608-435f-49c0-9573-686c290fd866 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:13.858454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3a608-435f-49c0-9573-686c290fd866 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:13.862631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424b01b-4ca3-4f7e-b79b-5e256b88f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:13.863206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424b01b-4ca3-4f7e-b79b-5e256b88f3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.863499 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424b01b-4ca3-4f7e-b79b-5e256b88f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.863784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424b01b-4ca3-4f7e-b79b-5e256b88f3d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.871385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424b01b-4ca3-4f7e-b79b-5e256b88f3d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:13.897193 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424b01b-4ca3-4f7e-b79b-5e256b88f3d1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:13.906204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 325/650] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:57:13 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:57:13.911890 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a402524-9ebd-4310-9aec-c64a0432b9a7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:13.921910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a402524-9ebd-4310-9aec-c64a0432b9a7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:13.925918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34577-c389-4708-9df7-84b475fba9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:13.926650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34577-c389-4708-9df7-84b475fba9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:13.926954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34577-c389-4708-9df7-84b475fba9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:13.927242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34577-c389-4708-9df7-84b475fba9d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:13.940308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34577-c389-4708-9df7-84b475fba9d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:13.965463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34577-c389-4708-9df7-84b475fba9d6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:13.982951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-7ee34577-c389-4708-9df7-84b475fba9d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:13.984058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 326/651] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:13.989837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424b01b-4ca3-4f7e-b79b-5e256b88f3d1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:13.999331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424b01b-4ca3-4f7e-b79b-5e256b88f3d1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:14.003780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb039b-1018-4198-b926-e0decbe06d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:14.004813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb039b-1018-4198-b926-e0decbe06d0e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:14.005279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb039b-1018-4198-b926-e0decbe06d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:14.005575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb039b-1018-4198-b926-e0decbe06d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:14.006279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb039b-1018-4198-b926-e0decbe06d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:14.006578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb039b-1018-4198-b926-e0decbe06d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:14.033418 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb039b-1018-4198-b926-e0decbe06d0e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:14.047487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 326/652] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:14.053084 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34577-c389-4708-9df7-84b475fba9d6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:14.063026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34577-c389-4708-9df7-84b475fba9d6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:14.066984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b70ecf-3232-46e4-97e1-d0109c20822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:14.067693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70ecf-3232-46e4-97e1-d0109c20822f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:14.067981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70ecf-3232-46e4-97e1-d0109c20822f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:14.068266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70ecf-3232-46e4-97e1-d0109c20822f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:14.077306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b70ecf-3232-46e4-97e1-d0109c20822f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:14.102582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b70ecf-3232-46e4-97e1-d0109c20822f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:14.117323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-f3b70ecf-3232-46e4-97e1-d0109c20822f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:57:14.118350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 327/653] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:57:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:14.124589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb039b-1018-4198-b926-e0decbe06d0e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:14.133807 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb039b-1018-4198-b926-e0decbe06d0e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:14.137828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b5f42-b6e1-43c3-990b-597e3de04327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:14.138405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b5f42-b6e1-43c3-990b-597e3de04327 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:14.138730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b5f42-b6e1-43c3-990b-597e3de04327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:14.139019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b5f42-b6e1-43c3-990b-597e3de04327 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:14.139756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b5f42-b6e1-43c3-990b-597e3de04327 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:14.140057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b5f42-b6e1-43c3-990b-597e3de04327 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:14.166149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b5f42-b6e1-43c3-990b-597e3de04327 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:14.179852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 327/654] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:57:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:14.185571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b70ecf-3232-46e4-97e1-d0109c20822f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:14.194796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b70ecf-3232-46e4-97e1-d0109c20822f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:14.198718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb71ce8-89f5-4dd8-b4bc-59e8ff5ea682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:14.199288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb71ce8-89f5-4dd8-b4bc-59e8ff5ea682 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:14.199582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb71ce8-89f5-4dd8-b4bc-59e8ff5ea682 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:14.199868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb71ce8-89f5-4dd8-b4bc-59e8ff5ea682 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:14.200951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb71ce8-89f5-4dd8-b4bc-59e8ff5ea682 admin admin] RBAC: Adding query filter params (role.id=bc2009b7668f441490dbec4c26f77ba8, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=4ecd9bf5e6f04ca5a246bcfb7200e34c) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:14.201264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb71ce8-89f5-4dd8-b4bc-59e8ff5ea682 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:14.227173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb71ce8-89f5-4dd8-b4bc-59e8ff5ea682 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:14.233601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 328/655] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:57:14 2021] GET /identity/v3/role_assignments?user.id=4ecd9bf5e6f04ca5a246bcfb7200e34c&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=bc2009b7668f441490dbec4c26f77ba8 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:16.208981 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e0a4c-badc-4e0f-98fb-0f0a6bddfe51 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:16.209589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e0a4c-badc-4e0f-98fb-0f0a6bddfe51 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:16.209589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e0a4c-badc-4e0f-98fb-0f0a6bddfe51 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:16.211250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 328/656] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:16.216843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542cf6d-5212-4d29-abf4-7a6a8ce6ed7b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:16.217227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542cf6d-5212-4d29-abf4-7a6a8ce6ed7b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:16.217416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542cf6d-5212-4d29-abf4-7a6a8ce6ed7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:16.239789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b542cf6d-5212-4d29-abf4-7a6a8ce6ed7b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:16.240927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b542cf6d-5212-4d29-abf4-7a6a8ce6ed7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:16.247808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 329/657] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:16 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:16.269185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e0a4c-badc-4e0f-98fb-0f0a6bddfe51 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:16.281250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e0a4c-badc-4e0f-98fb-0f0a6bddfe51 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:16.285298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63d83a-678b-40cf-833e-756dbed45b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:16.286009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63d83a-678b-40cf-833e-756dbed45b54 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:16.286302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63d83a-678b-40cf-833e-756dbed45b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:16.286589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63d83a-678b-40cf-833e-756dbed45b54 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:16.287242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63d83a-678b-40cf-833e-756dbed45b54 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:16.312843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63d83a-678b-40cf-833e-756dbed45b54 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:16.323001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-6a63d83a-678b-40cf-833e-756dbed45b54 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:57:16.324063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 329/658] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Oct 27 13:57:16 2021] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:16.330367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542cf6d-5212-4d29-abf4-7a6a8ce6ed7b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:16.338991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542cf6d-5212-4d29-abf4-7a6a8ce6ed7b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:16.343870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988cd59-2728-4ac5-abd7-73d10bba29fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:16.344447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988cd59-2728-4ac5-abd7-73d10bba29fc admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:16.344733 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988cd59-2728-4ac5-abd7-73d10bba29fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:16.345014 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988cd59-2728-4ac5-abd7-73d10bba29fc admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:16.345677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988cd59-2728-4ac5-abd7-73d10bba29fc admin admin] RBAC: Adding query filter params (name=image) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:16.345974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988cd59-2728-4ac5-abd7-73d10bba29fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:16.371427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988cd59-2728-4ac5-abd7-73d10bba29fc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:16.376492 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 330/659] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:16 2021] GET /identity/v3/services?name=image => generated 122 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:16.381804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63d83a-678b-40cf-833e-756dbed45b54 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:16.391658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63d83a-678b-40cf-833e-756dbed45b54 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:16.395557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3c469-c3ae-4022-a1fc-8315500bb823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:16.396226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3c469-c3ae-4022-a1fc-8315500bb823 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:16.396414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3c469-c3ae-4022-a1fc-8315500bb823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:16.396745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3c469-c3ae-4022-a1fc-8315500bb823 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:16.397351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3c469-c3ae-4022-a1fc-8315500bb823 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:16.397646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3c469-c3ae-4022-a1fc-8315500bb823 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:16.422798 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3c469-c3ae-4022-a1fc-8315500bb823 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:16.427121 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 330/660] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:16 2021] GET /identity/v3/services?type=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:18.371559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db7097-2a9e-4692-b3c5-8f693ce52d34 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:18.372211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db7097-2a9e-4692-b3c5-8f693ce52d34 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:18.372211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db7097-2a9e-4692-b3c5-8f693ce52d34 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:18.373873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 331/661] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:18.379044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0571-c40e-46e4-b0f3-bf0a17579cfa None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:18.379463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0571-c40e-46e4-b0f3-bf0a17579cfa None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:18.379623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0571-c40e-46e4-b0f3-bf0a17579cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:18.402312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-a44d0571-c40e-46e4-b0f3-bf0a17579cfa None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:18.404021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a44d0571-c40e-46e4-b0f3-bf0a17579cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:18.410607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 331/662] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:18 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:18.432175 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db7097-2a9e-4692-b3c5-8f693ce52d34 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:18.443783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db7097-2a9e-4692-b3c5-8f693ce52d34 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:18.447637 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88327267-d72f-4a1c-93b4-f62048dbfb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:18.448226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327267-d72f-4a1c-93b4-f62048dbfb18 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:18.448517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327267-d72f-4a1c-93b4-f62048dbfb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:18.448800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327267-d72f-4a1c-93b4-f62048dbfb18 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:18.449476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88327267-d72f-4a1c-93b4-f62048dbfb18 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:18.483678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88327267-d72f-4a1c-93b4-f62048dbfb18 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:18.497262 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 332/663] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:57:18 2021] POST /identity/v3/services => generated 242 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:57:20.571489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde991e-c75a-4710-9c6c-591582377441 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:20.572020 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde991e-c75a-4710-9c6c-591582377441 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:20.572105 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde991e-c75a-4710-9c6c-591582377441 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:20.573722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 332/664] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:20.579406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365fdf2-11de-4aec-a634-cbffc8aede9b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:20.579951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365fdf2-11de-4aec-a634-cbffc8aede9b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:20.580038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365fdf2-11de-4aec-a634-cbffc8aede9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:20.602509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5365fdf2-11de-4aec-a634-cbffc8aede9b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:20.603652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5365fdf2-11de-4aec-a634-cbffc8aede9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:20.620363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 333/665] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:20 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:20.641636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde991e-c75a-4710-9c6c-591582377441 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:20.653767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde991e-c75a-4710-9c6c-591582377441 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:20.657823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b28cf8-6565-46a7-964d-b76bd4630a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:20.658531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b28cf8-6565-46a7-964d-b76bd4630a2d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:20.658849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b28cf8-6565-46a7-964d-b76bd4630a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:20.659128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b28cf8-6565-46a7-964d-b76bd4630a2d admin admin] PATH_INFO: `/v3/services/image` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:20.659743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b28cf8-6565-46a7-964d-b76bd4630a2d admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:20.684942 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b28cf8-6565-46a7-964d-b76bd4630a2d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:20.694944 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-79b28cf8-6565-46a7-964d-b76bd4630a2d admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:57:20.695981 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 333/666] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Oct 27 13:57:20 2021] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:20.702267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365fdf2-11de-4aec-a634-cbffc8aede9b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:20.710890 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365fdf2-11de-4aec-a634-cbffc8aede9b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:20.714858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad60d0-98f1-418c-99c0-01fb525408f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:20.716001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad60d0-98f1-418c-99c0-01fb525408f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:20.716303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad60d0-98f1-418c-99c0-01fb525408f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:20.716741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad60d0-98f1-418c-99c0-01fb525408f5 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:20.717421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad60d0-98f1-418c-99c0-01fb525408f5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:20.717722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad60d0-98f1-418c-99c0-01fb525408f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:20.743211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad60d0-98f1-418c-99c0-01fb525408f5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:20.747726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 334/667] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:20 2021] GET /identity/v3/services?name=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:20.753091 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b28cf8-6565-46a7-964d-b76bd4630a2d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:20.762185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b28cf8-6565-46a7-964d-b76bd4630a2d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:20.767080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98df1ec-9424-49b3-a565-0cb643f8725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:20.767665 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98df1ec-9424-49b3-a565-0cb643f8725c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:20.767952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98df1ec-9424-49b3-a565-0cb643f8725c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:20.768239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98df1ec-9424-49b3-a565-0cb643f8725c admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:20.768906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98df1ec-9424-49b3-a565-0cb643f8725c admin admin] RBAC: Adding query filter params (type=image) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:20.769207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98df1ec-9424-49b3-a565-0cb643f8725c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:20.795084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98df1ec-9424-49b3-a565-0cb643f8725c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:20.799782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 334/668] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:20 2021] GET /identity/v3/services?type=image => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:20.805357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad60d0-98f1-418c-99c0-01fb525408f5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:20.814798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad60d0-98f1-418c-99c0-01fb525408f5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:20.818864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bf965-f6b4-4956-ba80-dd91cef56a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:20.819449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bf965-f6b4-4956-ba80-dd91cef56a26 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:20.819742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bf965-f6b4-4956-ba80-dd91cef56a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:20.820028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bf965-f6b4-4956-ba80-dd91cef56a26 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:20.820783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bf965-f6b4-4956-ba80-dd91cef56a26 admin admin] RBAC: Adding query filter params (interface=public, service_id=39d2671756084850a9d71b48c85278cb, region_id=RegionOne) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:20.821091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bf965-f6b4-4956-ba80-dd91cef56a26 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:20.847440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bf965-f6b4-4956-ba80-dd91cef56a26 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:20.853159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 335/669] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Oct 27 13:57:20 2021] GET /identity/v3/endpoints?service_id=39d2671756084850a9d71b48c85278cb&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:20.858961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98df1ec-9424-49b3-a565-0cb643f8725c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:20.868509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98df1ec-9424-49b3-a565-0cb643f8725c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:20.873020 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9c83d-e67a-4228-a883-bcabd2f05e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:20.873602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c83d-e67a-4228-a883-bcabd2f05e88 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:20.873895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c83d-e67a-4228-a883-bcabd2f05e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:20.874183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c83d-e67a-4228-a883-bcabd2f05e88 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:20.874861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9c83d-e67a-4228-a883-bcabd2f05e88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:20.900505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9c83d-e67a-4228-a883-bcabd2f05e88 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:20.906207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 335/670] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 13:57:20 2021] GET /identity/v3/services => generated 1022 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:57:22.892507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def129ba-f609-474a-a8ee-7cb1c6fd159e None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:22.893039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def129ba-f609-474a-a8ee-7cb1c6fd159e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:22.893148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def129ba-f609-474a-a8ee-7cb1c6fd159e None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:22.894775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 336/671] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:22.899830 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e4252-303c-41ae-bcae-bffd1a424a88 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:22.900221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e4252-303c-41ae-bcae-bffd1a424a88 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:22.900414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e4252-303c-41ae-bcae-bffd1a424a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:22.924882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-d74e4252-303c-41ae-bcae-bffd1a424a88 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:22.926007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d74e4252-303c-41ae-bcae-bffd1a424a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:22.932652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 336/672] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:22 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:57:22.955965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def129ba-f609-474a-a8ee-7cb1c6fd159e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:22.968446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def129ba-f609-474a-a8ee-7cb1c6fd159e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:22.972322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146433e-9045-44b8-bc5b-51cace10dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:22.973030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146433e-9045-44b8-bc5b-51cace10dc34 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:22.973322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146433e-9045-44b8-bc5b-51cace10dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:22.973606 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146433e-9045-44b8-bc5b-51cace10dc34 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:22.974228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146433e-9045-44b8-bc5b-51cace10dc34 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:22.999628 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146433e-9045-44b8-bc5b-51cace10dc34 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:23.013646 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-9146433e-9045-44b8-bc5b-51cace10dc34 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 13:57:23.014769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 337/673] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Oct 27 13:57:22 2021] GET /identity/v3/services/image => generated 86 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:23.020512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e4252-303c-41ae-bcae-bffd1a424a88 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:23.029840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e4252-303c-41ae-bcae-bffd1a424a88 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:23.033815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88029661-f2cd-4d6e-88e6-365f809449c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:23.034398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88029661-f2cd-4d6e-88e6-365f809449c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:23.034724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88029661-f2cd-4d6e-88e6-365f809449c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:23.035008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88029661-f2cd-4d6e-88e6-365f809449c1 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:23.035673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88029661-f2cd-4d6e-88e6-365f809449c1 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:23.035978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88029661-f2cd-4d6e-88e6-365f809449c1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:23.063031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88029661-f2cd-4d6e-88e6-365f809449c1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:23.067970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 337/674] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:23 2021] GET /identity/v3/services?name=image => generated 122 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:23.073643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146433e-9045-44b8-bc5b-51cace10dc34 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:23.083593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146433e-9045-44b8-bc5b-51cace10dc34 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:23.087722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1803a-e700-4c3a-9e9e-0c9f40bff069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:23.088380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1803a-e700-4c3a-9e9e-0c9f40bff069 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:23.088676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1803a-e700-4c3a-9e9e-0c9f40bff069 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:23.089106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1803a-e700-4c3a-9e9e-0c9f40bff069 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:23.090106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1803a-e700-4c3a-9e9e-0c9f40bff069 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:23.091024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1803a-e700-4c3a-9e9e-0c9f40bff069 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:23.118209 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1803a-e700-4c3a-9e9e-0c9f40bff069 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:23.123703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 338/675] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:23 2021] GET /identity/v3/services?type=image => generated 350 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:23.129239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88029661-f2cd-4d6e-88e6-365f809449c1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:23.138941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88029661-f2cd-4d6e-88e6-365f809449c1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:23.142891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de753259-6727-4063-abb0-892da4f7802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:23.143405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de753259-6727-4063-abb0-892da4f7802e admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:23.143690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de753259-6727-4063-abb0-892da4f7802e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:23.143969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de753259-6727-4063-abb0-892da4f7802e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:23.144642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de753259-6727-4063-abb0-892da4f7802e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:23.169441 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de753259-6727-4063-abb0-892da4f7802e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:23.188150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 338/676] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 13:57:23 2021] POST /identity/v3/endpoints => generated 327 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:57:25.187559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65996d91-5324-44d0-9efd-5e09cbd2fc54 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:25.188105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65996d91-5324-44d0-9efd-5e09cbd2fc54 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:25.188105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65996d91-5324-44d0-9efd-5e09cbd2fc54 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:25.189795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 339/677] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:25.194956 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccb73d-f509-4e63-b99e-abc2d087154a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:25.195337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccb73d-f509-4e63-b99e-abc2d087154a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:25.195534 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccb73d-f509-4e63-b99e-abc2d087154a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:25.217429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-82ccb73d-f509-4e63-b99e-abc2d087154a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:25.218557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-82ccb73d-f509-4e63-b99e-abc2d087154a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:25.235073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 339/678] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:25 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:25.256979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65996d91-5324-44d0-9efd-5e09cbd2fc54 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:25.268557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65996d91-5324-44d0-9efd-5e09cbd2fc54 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:25.272371 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f89f1-dce9-4661-97b5-707648471179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:25.272942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f89f1-dce9-4661-97b5-707648471179 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:25.273235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f89f1-dce9-4661-97b5-707648471179 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:25.273521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f89f1-dce9-4661-97b5-707648471179 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:25.281313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f89f1-dce9-4661-97b5-707648471179 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:25.307184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f89f1-dce9-4661-97b5-707648471179 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:25.317660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 340/679] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:57:25 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:57:25.323459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccb73d-f509-4e63-b99e-abc2d087154a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:25.331917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccb73d-f509-4e63-b99e-abc2d087154a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:25.335872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86b618-ad34-4d29-9ed6-b2b033a7d623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:25.336580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86b618-ad34-4d29-9ed6-b2b033a7d623 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:25.336865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86b618-ad34-4d29-9ed6-b2b033a7d623 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:25.337142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86b618-ad34-4d29-9ed6-b2b033a7d623 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:25.338186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86b618-ad34-4d29-9ed6-b2b033a7d623 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:25.363726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86b618-ad34-4d29-9ed6-b2b033a7d623 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:25.365152 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 340/680] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:27.451756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b261818-16eb-49d9-a52f-d6b32734db3d None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:27.452277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b261818-16eb-49d9-a52f-d6b32734db3d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:27.452388 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b261818-16eb-49d9-a52f-d6b32734db3d None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:27.453999 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 341/681] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:27.459108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af072d19-ecd4-4101-abd8-dff5d214a638 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:27.459483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af072d19-ecd4-4101-abd8-dff5d214a638 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:27.459672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af072d19-ecd4-4101-abd8-dff5d214a638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:27.482373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-af072d19-ecd4-4101-abd8-dff5d214a638 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:27.483531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-af072d19-ecd4-4101-abd8-dff5d214a638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:27.491972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 341/682] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:27 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:27.515861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b261818-16eb-49d9-a52f-d6b32734db3d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:27.531087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b261818-16eb-49d9-a52f-d6b32734db3d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:27.535158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a3c42-24fd-4404-9527-25d25963c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:27.535865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a3c42-24fd-4404-9527-25d25963c422 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:27.536146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a3c42-24fd-4404-9527-25d25963c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:27.536427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a3c42-24fd-4404-9527-25d25963c422 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:27.547853 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a3c42-24fd-4404-9527-25d25963c422 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:27.573410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a3c42-24fd-4404-9527-25d25963c422 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:27.591131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-1a3a3c42-24fd-4404-9527-25d25963c422 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:27.592197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 342/683] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:27.598023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af072d19-ecd4-4101-abd8-dff5d214a638 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:27.606712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af072d19-ecd4-4101-abd8-dff5d214a638 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:27.611051 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826477fb-dc71-4405-8cad-c88a25b57e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:27.611637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826477fb-dc71-4405-8cad-c88a25b57e2c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:27.611929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826477fb-dc71-4405-8cad-c88a25b57e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:27.612212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826477fb-dc71-4405-8cad-c88a25b57e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:27.612897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826477fb-dc71-4405-8cad-c88a25b57e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:27.613198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826477fb-dc71-4405-8cad-c88a25b57e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:27.639302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826477fb-dc71-4405-8cad-c88a25b57e2c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:27.651974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 342/684] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:27.657477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a3c42-24fd-4404-9527-25d25963c422 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:27.666554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a3c42-24fd-4404-9527-25d25963c422 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:27.670459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66481bfb-1217-462d-ab5e-a26a513259b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:27.671076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66481bfb-1217-462d-ab5e-a26a513259b3 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:27.671361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66481bfb-1217-462d-ab5e-a26a513259b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:27.671640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66481bfb-1217-462d-ab5e-a26a513259b3 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:27.672272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66481bfb-1217-462d-ab5e-a26a513259b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:27.698217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66481bfb-1217-462d-ab5e-a26a513259b3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:27.718253 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 343/685] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:57:27 2021] POST /identity/v3/users => generated 248 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:57:29.720865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ae46-996a-4169-943d-931b483d00ee None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:29.721425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ae46-996a-4169-943d-931b483d00ee None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:29.721425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ae46-996a-4169-943d-931b483d00ee None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:29.723149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 343/686] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:29.728348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77b0d-47fc-49cd-b563-008ed6e71943 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:29.728735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77b0d-47fc-49cd-b563-008ed6e71943 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:29.728969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77b0d-47fc-49cd-b563-008ed6e71943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:29.752638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-34c77b0d-47fc-49cd-b563-008ed6e71943 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:29.753753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-34c77b0d-47fc-49cd-b563-008ed6e71943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:29.761481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 344/687] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:29 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:29.783501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ae46-996a-4169-943d-931b483d00ee None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:29.795587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ae46-996a-4169-943d-931b483d00ee None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:29.799466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b32a8e-c79a-4076-a3f8-bea4d9516fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:29.800179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32a8e-c79a-4076-a3f8-bea4d9516fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:29.800473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32a8e-c79a-4076-a3f8-bea4d9516fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:29.800758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32a8e-c79a-4076-a3f8-bea4d9516fc6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:29.812915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b32a8e-c79a-4076-a3f8-bea4d9516fc6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:57:29.821817 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e0b32a8e-c79a-4076-a3f8-bea4d9516fc6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:57:29.823046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 344/688] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:57:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:29.830043 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c77b0d-47fc-49cd-b563-008ed6e71943 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:29.838818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c77b0d-47fc-49cd-b563-008ed6e71943 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:29.843058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776565-a613-469e-9b43-e6a9078035d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:29.843648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776565-a613-469e-9b43-e6a9078035d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:29.843936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776565-a613-469e-9b43-e6a9078035d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:29.844218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776565-a613-469e-9b43-e6a9078035d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:29.844920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12776565-a613-469e-9b43-e6a9078035d3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:29.845216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12776565-a613-469e-9b43-e6a9078035d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:29.870972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12776565-a613-469e-9b43-e6a9078035d3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:29.880402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 345/689] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:57:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:29.886494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b32a8e-c79a-4076-a3f8-bea4d9516fc6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:29.896313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b32a8e-c79a-4076-a3f8-bea4d9516fc6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:29.900266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e6b99-44c1-4555-9d29-4cbfbe74ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:29.900979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e6b99-44c1-4555-9d29-4cbfbe74ca24 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:29.901272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e6b99-44c1-4555-9d29-4cbfbe74ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:29.901559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e6b99-44c1-4555-9d29-4cbfbe74ca24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:29.913050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e6b99-44c1-4555-9d29-4cbfbe74ca24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:29.939992 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e6b99-44c1-4555-9d29-4cbfbe74ca24 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:29.958479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-149e6b99-44c1-4555-9d29-4cbfbe74ca24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:29.959610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 345/690] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:29.966140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776565-a613-469e-9b43-e6a9078035d3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:29.975477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776565-a613-469e-9b43-e6a9078035d3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:29.979366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14093c-f8a5-4d93-8b9f-a2aa5aeec1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:29.979947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14093c-f8a5-4d93-8b9f-a2aa5aeec1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:29.980236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14093c-f8a5-4d93-8b9f-a2aa5aeec1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:29.980518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14093c-f8a5-4d93-8b9f-a2aa5aeec1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:29.981790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14093c-f8a5-4d93-8b9f-a2aa5aeec1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:29.982085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14093c-f8a5-4d93-8b9f-a2aa5aeec1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:30.007287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14093c-f8a5-4d93-8b9f-a2aa5aeec1e5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:30.020346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 346/691] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:30.025911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e6b99-44c1-4555-9d29-4cbfbe74ca24 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:30.036173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e6b99-44c1-4555-9d29-4cbfbe74ca24 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:30.040132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6be741-add1-4431-a2ef-377b27fdee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:30.040847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be741-add1-4431-a2ef-377b27fdee09 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:30.041137 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be741-add1-4431-a2ef-377b27fdee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:30.041421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be741-add1-4431-a2ef-377b27fdee09 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:30.054697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6be741-add1-4431-a2ef-377b27fdee09 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:30.080710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6be741-add1-4431-a2ef-377b27fdee09 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:30.098779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-ee6be741-add1-4431-a2ef-377b27fdee09 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:57:30.099836 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 346/692] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:57:30 2021] GET /identity/v3/users/cinder => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:30.105387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14093c-f8a5-4d93-8b9f-a2aa5aeec1e5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:30.115599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14093c-f8a5-4d93-8b9f-a2aa5aeec1e5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:30.119548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1687ca-d7cf-4c06-b97c-1674e123c350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:30.120140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1687ca-d7cf-4c06-b97c-1674e123c350 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:30.120434 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1687ca-d7cf-4c06-b97c-1674e123c350 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:30.120722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1687ca-d7cf-4c06-b97c-1674e123c350 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:30.121726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1687ca-d7cf-4c06-b97c-1674e123c350 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:30.122036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1687ca-d7cf-4c06-b97c-1674e123c350 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:30.147387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1687ca-d7cf-4c06-b97c-1674e123c350 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:30.178206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 347/693] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Oct 27 13:57:30 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:30.183987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6be741-add1-4431-a2ef-377b27fdee09 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:30.193264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6be741-add1-4431-a2ef-377b27fdee09 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:30.197173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e09390-105f-4abf-aa2e-8a028a739458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:30.197740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e09390-105f-4abf-aa2e-8a028a739458 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:30.198036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e09390-105f-4abf-aa2e-8a028a739458 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:30.198302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e09390-105f-4abf-aa2e-8a028a739458 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:30.205944 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e09390-105f-4abf-aa2e-8a028a739458 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:30.232692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e09390-105f-4abf-aa2e-8a028a739458 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:30.244009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 347/694] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:57:30 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:57:30.249705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1687ca-d7cf-4c06-b97c-1674e123c350 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:30.259140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1687ca-d7cf-4c06-b97c-1674e123c350 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:30.263676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d4668-886c-4895-9955-7d98f3b504bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:30.264392 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d4668-886c-4895-9955-7d98f3b504bc admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:30.264683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d4668-886c-4895-9955-7d98f3b504bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:30.264966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d4668-886c-4895-9955-7d98f3b504bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:30.276979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d4668-886c-4895-9955-7d98f3b504bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:30.303409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d4668-886c-4895-9955-7d98f3b504bc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:30.320331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-132d4668-886c-4895-9955-7d98f3b504bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:30.321424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 348/695] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:30.327718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e09390-105f-4abf-aa2e-8a028a739458 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:30.336175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e09390-105f-4abf-aa2e-8a028a739458 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:30.348179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb16795-f183-42d7-9f95-893dbf5729de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:30.348761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16795-f183-42d7-9f95-893dbf5729de admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:30.349061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16795-f183-42d7-9f95-893dbf5729de admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:30.349642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16795-f183-42d7-9f95-893dbf5729de admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:30.350449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb16795-f183-42d7-9f95-893dbf5729de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:30.350835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb16795-f183-42d7-9f95-893dbf5729de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:30.376453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb16795-f183-42d7-9f95-893dbf5729de admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:30.390454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 348/696] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:30.395977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d4668-886c-4895-9955-7d98f3b504bc admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:30.405679 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d4668-886c-4895-9955-7d98f3b504bc admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:30.409535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb21535-a74e-4c3d-a4d4-c911786da04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:30.410240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb21535-a74e-4c3d-a4d4-c911786da04a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:30.410525 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb21535-a74e-4c3d-a4d4-c911786da04a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:30.410833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb21535-a74e-4c3d-a4d4-c911786da04a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:30.419730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb21535-a74e-4c3d-a4d4-c911786da04a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:30.444797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb21535-a74e-4c3d-a4d4-c911786da04a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:30.458781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-4bb21535-a74e-4c3d-a4d4-c911786da04a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:57:30.459839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 349/697] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:57:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:30.466242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb16795-f183-42d7-9f95-893dbf5729de admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:30.475570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb16795-f183-42d7-9f95-893dbf5729de admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:30.479592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99616b-4cdd-41ee-bead-132bcca60fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:30.480177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99616b-4cdd-41ee-bead-132bcca60fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:30.480470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99616b-4cdd-41ee-bead-132bcca60fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:30.480883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99616b-4cdd-41ee-bead-132bcca60fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:30.481714 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99616b-4cdd-41ee-bead-132bcca60fb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:30.482023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99616b-4cdd-41ee-bead-132bcca60fb7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:30.507519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99616b-4cdd-41ee-bead-132bcca60fb7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:30.520978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 349/698] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:57:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:30.526872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb21535-a74e-4c3d-a4d4-c911786da04a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:30.536775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb21535-a74e-4c3d-a4d4-c911786da04a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:30.540678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07301c5d-54ef-4154-ba16-8c7af44c2f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:30.541247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07301c5d-54ef-4154-ba16-8c7af44c2f24 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:30.541533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07301c5d-54ef-4154-ba16-8c7af44c2f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:30.541811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07301c5d-54ef-4154-ba16-8c7af44c2f24 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:30.542574 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07301c5d-54ef-4154-ba16-8c7af44c2f24 admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=3c014f6c51ed4c99a1a4450dde18cbef) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:30.542904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07301c5d-54ef-4154-ba16-8c7af44c2f24 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:30.568476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07301c5d-54ef-4154-ba16-8c7af44c2f24 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:30.574031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 350/699] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:57:30 2021] GET /identity/v3/role_assignments?user.id=3c014f6c51ed4c99a1a4450dde18cbef&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:32.528500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b132-3b5b-4de9-8388-8adac0ae7a5c None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:32.529027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b132-3b5b-4de9-8388-8adac0ae7a5c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:32.529114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b132-3b5b-4de9-8388-8adac0ae7a5c None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:32.530733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 350/700] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:32.536024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435ab9-6455-4232-9869-04945b74e9c1 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:32.536436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435ab9-6455-4232-9869-04945b74e9c1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:32.536584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435ab9-6455-4232-9869-04945b74e9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:32.559133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-09435ab9-6455-4232-9869-04945b74e9c1 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:32.560263 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-09435ab9-6455-4232-9869-04945b74e9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:32.566810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 351/701] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:32 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:32.588670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780b132-3b5b-4de9-8388-8adac0ae7a5c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:32.600772 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780b132-3b5b-4de9-8388-8adac0ae7a5c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:32.604756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c528-4ac7-41c8-af74-44704eaaf2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:32.605477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c528-4ac7-41c8-af74-44704eaaf2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:32.605828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c528-4ac7-41c8-af74-44704eaaf2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:32.606119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c528-4ac7-41c8-af74-44704eaaf2f5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:32.617309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954c528-4ac7-41c8-af74-44704eaaf2f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:57:32.623741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-c954c528-4ac7-41c8-af74-44704eaaf2f5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:57:32.624829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 351/702] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:57:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:32.630608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09435ab9-6455-4232-9869-04945b74e9c1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:32.640151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09435ab9-6455-4232-9869-04945b74e9c1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:32.644110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91ec7d-8208-44b5-983b-e14395fbfafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:32.644696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91ec7d-8208-44b5-983b-e14395fbfafc admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:32.644985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91ec7d-8208-44b5-983b-e14395fbfafc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:32.645267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91ec7d-8208-44b5-983b-e14395fbfafc admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:32.645969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91ec7d-8208-44b5-983b-e14395fbfafc admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:32.646270 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91ec7d-8208-44b5-983b-e14395fbfafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:32.672522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91ec7d-8208-44b5-983b-e14395fbfafc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:32.680898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 352/703] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:57:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:32.686617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c528-4ac7-41c8-af74-44704eaaf2f5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:32.696164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c528-4ac7-41c8-af74-44704eaaf2f5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:32.701018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08803b-a697-483a-9fcc-d151546282ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:32.701717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08803b-a697-483a-9fcc-d151546282ed admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:32.702007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08803b-a697-483a-9fcc-d151546282ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:32.702292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08803b-a697-483a-9fcc-d151546282ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:32.713257 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08803b-a697-483a-9fcc-d151546282ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:32.739738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08803b-a697-483a-9fcc-d151546282ed admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:32.757240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-0c08803b-a697-483a-9fcc-d151546282ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:32.758299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 352/704] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:32.764354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91ec7d-8208-44b5-983b-e14395fbfafc admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:32.773605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91ec7d-8208-44b5-983b-e14395fbfafc admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:32.778164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df85c6-343e-4236-b917-8518a58f2a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:32.778831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df85c6-343e-4236-b917-8518a58f2a54 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:32.779075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df85c6-343e-4236-b917-8518a58f2a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:32.779362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df85c6-343e-4236-b917-8518a58f2a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:32.780044 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df85c6-343e-4236-b917-8518a58f2a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:32.780350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df85c6-343e-4236-b917-8518a58f2a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:32.805550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df85c6-343e-4236-b917-8518a58f2a54 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:32.818473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 353/705] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:32.824243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08803b-a697-483a-9fcc-d151546282ed admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:32.834327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08803b-a697-483a-9fcc-d151546282ed admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:32.838324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9df56a-2d38-4c9f-a644-dc1ff724a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:32.839077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df56a-2d38-4c9f-a644-dc1ff724a5ef admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:32.839368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df56a-2d38-4c9f-a644-dc1ff724a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:32.839656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df56a-2d38-4c9f-a644-dc1ff724a5ef admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:32.852813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9df56a-2d38-4c9f-a644-dc1ff724a5ef admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:32.880014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9df56a-2d38-4c9f-a644-dc1ff724a5ef admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:32.899602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-cf9df56a-2d38-4c9f-a644-dc1ff724a5ef admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:57:32.900738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 353/706] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:57:32 2021] GET /identity/v3/users/cinder => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:57:32.906840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df85c6-343e-4236-b917-8518a58f2a54 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:32.916237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df85c6-343e-4236-b917-8518a58f2a54 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:32.920369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9741c-9879-4687-881c-8ecc22280f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:32.920961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9741c-9879-4687-881c-8ecc22280f3f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:32.921260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9741c-9879-4687-881c-8ecc22280f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:32.921546 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9741c-9879-4687-881c-8ecc22280f3f admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:32.922335 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9741c-9879-4687-881c-8ecc22280f3f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:32.922659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9741c-9879-4687-881c-8ecc22280f3f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:32.948299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9741c-9879-4687-881c-8ecc22280f3f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:32.977765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 354/707] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Oct 27 13:57:32 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:32.983605 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9df56a-2d38-4c9f-a644-dc1ff724a5ef admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:32.993086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9df56a-2d38-4c9f-a644-dc1ff724a5ef admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:32.997577 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1107e-837b-4ca1-9091-98434ba36643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:32.998296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1107e-837b-4ca1-9091-98434ba36643 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:32.998581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1107e-837b-4ca1-9091-98434ba36643 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:32.998895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1107e-837b-4ca1-9091-98434ba36643 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:33.016131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1107e-837b-4ca1-9091-98434ba36643 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:33.042511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1107e-837b-4ca1-9091-98434ba36643 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:33.060952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-83b1107e-837b-4ca1-9091-98434ba36643 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:33.062864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 354/708] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:33.069339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9741c-9879-4687-881c-8ecc22280f3f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:33.079170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9741c-9879-4687-881c-8ecc22280f3f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:33.083870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2f11b-bc70-4028-afa5-5ff53b1f5290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:33.084458 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2f11b-bc70-4028-afa5-5ff53b1f5290 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:33.084758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2f11b-bc70-4028-afa5-5ff53b1f5290 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:33.085042 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2f11b-bc70-4028-afa5-5ff53b1f5290 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:33.085735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2f11b-bc70-4028-afa5-5ff53b1f5290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:33.086038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2f11b-bc70-4028-afa5-5ff53b1f5290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:33.111953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2f11b-bc70-4028-afa5-5ff53b1f5290 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:33.124861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 355/709] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:33.130341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1107e-837b-4ca1-9091-98434ba36643 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:33.140028 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1107e-837b-4ca1-9091-98434ba36643 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:33.143942 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e44e-aeff-44f1-946e-acbc6ebf76ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:33.144646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e44e-aeff-44f1-946e-acbc6ebf76ef admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:33.144929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e44e-aeff-44f1-946e-acbc6ebf76ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:33.145203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e44e-aeff-44f1-946e-acbc6ebf76ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:33.153947 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6e44e-aeff-44f1-946e-acbc6ebf76ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:33.178915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6e44e-aeff-44f1-946e-acbc6ebf76ef admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:33.192483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e9d6e44e-aeff-44f1-946e-acbc6ebf76ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:57:33.193531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 355/710] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:57:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:33.199103 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2f11b-bc70-4028-afa5-5ff53b1f5290 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:33.209027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2f11b-bc70-4028-afa5-5ff53b1f5290 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:33.213080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62e0ce-0b63-4737-a768-73f08f1b1530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:33.213666 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62e0ce-0b63-4737-a768-73f08f1b1530 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:33.213955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62e0ce-0b63-4737-a768-73f08f1b1530 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:33.214242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62e0ce-0b63-4737-a768-73f08f1b1530 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:33.215064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62e0ce-0b63-4737-a768-73f08f1b1530 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:33.215454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62e0ce-0b63-4737-a768-73f08f1b1530 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:33.241471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62e0ce-0b63-4737-a768-73f08f1b1530 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:33.254981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 356/711] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:57:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:33.260566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e44e-aeff-44f1-946e-acbc6ebf76ef admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:33.269754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e44e-aeff-44f1-946e-acbc6ebf76ef admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:33.273765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddd4c3-e7c2-41a9-b546-0d90a494fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:33.274574 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd4c3-e7c2-41a9-b546-0d90a494fe7f admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:33.274893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd4c3-e7c2-41a9-b546-0d90a494fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:33.275177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd4c3-e7c2-41a9-b546-0d90a494fe7f admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/3c014f6c51ed4c99a1a4450dde18cbef/roles/18aaf45888374560a4c11e1912d42c97` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:33.295069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddd4c3-e7c2-41a9-b546-0d90a494fe7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=3c014f6c51ed4c99a1a4450dde18cbef, role_id=18aaf45888374560a4c11e1912d42c97)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:33.321502 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddd4c3-e7c2-41a9-b546-0d90a494fe7f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:33.334471 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 356/712] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:57:33 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/3c014f6c51ed4c99a1a4450dde18cbef/roles/18aaf45888374560a4c11e1912d42c97 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:57:35.289753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0039b5-75a6-4dad-ab2d-678745854cb5 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.290250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0039b5-75a6-4dad-ab2d-678745854cb5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.290250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0039b5-75a6-4dad-ab2d-678745854cb5 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.291943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 357/713] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:35.297651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5252f-3157-4f66-a181-f75af6ca61bc None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.298064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5252f-3157-4f66-a181-f75af6ca61bc None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.298224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5252f-3157-4f66-a181-f75af6ca61bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.320507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c8d5252f-3157-4f66-a181-f75af6ca61bc None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:35.321641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c8d5252f-3157-4f66-a181-f75af6ca61bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:35.383749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 357/714] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:35 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:57:35.406447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0039b5-75a6-4dad-ab2d-678745854cb5 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:35.417946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0039b5-75a6-4dad-ab2d-678745854cb5 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:35.422425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c7ff-aa59-4556-b75a-67151c0e776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:35.423169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c7ff-aa59-4556-b75a-67151c0e776e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.423457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c7ff-aa59-4556-b75a-67151c0e776e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.423736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c7ff-aa59-4556-b75a-67151c0e776e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.435013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6c7ff-aa59-4556-b75a-67151c0e776e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:57:35.441265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-48b6c7ff-aa59-4556-b75a-67151c0e776e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:57:35.442360 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 358/715] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:57:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:35.448223 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5252f-3157-4f66-a181-f75af6ca61bc None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:35.456873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5252f-3157-4f66-a181-f75af6ca61bc None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:35.460937 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbb798-ad38-4656-9408-ebe5182c688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:35.461533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbb798-ad38-4656-9408-ebe5182c688f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.461825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbb798-ad38-4656-9408-ebe5182c688f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.462113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbb798-ad38-4656-9408-ebe5182c688f admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.462853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbb798-ad38-4656-9408-ebe5182c688f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:35.463157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbb798-ad38-4656-9408-ebe5182c688f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:35.489877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbb798-ad38-4656-9408-ebe5182c688f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:35.498949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 358/716] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:57:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:35.504604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c7ff-aa59-4556-b75a-67151c0e776e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:35.515416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c7ff-aa59-4556-b75a-67151c0e776e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:35.519373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe30cb5-b642-40bf-84da-8c0b70fd11cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:35.520080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe30cb5-b642-40bf-84da-8c0b70fd11cf admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.520370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe30cb5-b642-40bf-84da-8c0b70fd11cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.520654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe30cb5-b642-40bf-84da-8c0b70fd11cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.532839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe30cb5-b642-40bf-84da-8c0b70fd11cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:35.563421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe30cb5-b642-40bf-84da-8c0b70fd11cf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:35.581708 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-cbe30cb5-b642-40bf-84da-8c0b70fd11cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:35.582809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 359/717] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:35.588325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbb798-ad38-4656-9408-ebe5182c688f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:35.598211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbb798-ad38-4656-9408-ebe5182c688f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:35.602254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09794bc-6e39-411f-8fdb-e62656b78540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:35.602867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09794bc-6e39-411f-8fdb-e62656b78540 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.603158 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09794bc-6e39-411f-8fdb-e62656b78540 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.603436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09794bc-6e39-411f-8fdb-e62656b78540 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.604108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09794bc-6e39-411f-8fdb-e62656b78540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:35.604404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09794bc-6e39-411f-8fdb-e62656b78540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:35.629450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09794bc-6e39-411f-8fdb-e62656b78540 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:35.642315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 359/718] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:35.647672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe30cb5-b642-40bf-84da-8c0b70fd11cf admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:35.657845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe30cb5-b642-40bf-84da-8c0b70fd11cf admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:35.661915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe9e8a-f673-41e9-8567-5f8ac6802efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:35.662642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe9e8a-f673-41e9-8567-5f8ac6802efd admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.662936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe9e8a-f673-41e9-8567-5f8ac6802efd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.663220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe9e8a-f673-41e9-8567-5f8ac6802efd admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.676136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe9e8a-f673-41e9-8567-5f8ac6802efd admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:35.703245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe9e8a-f673-41e9-8567-5f8ac6802efd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:35.721602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-65fe9e8a-f673-41e9-8567-5f8ac6802efd admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:57:35.722709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 360/719] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:57:35 2021] GET /identity/v3/users/cinder => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:35.728198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09794bc-6e39-411f-8fdb-e62656b78540 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:35.737630 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09794bc-6e39-411f-8fdb-e62656b78540 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:35.741577 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed0538-f45d-4f65-acc9-4e81039a2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:35.742160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed0538-f45d-4f65-acc9-4e81039a2818 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.742446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed0538-f45d-4f65-acc9-4e81039a2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.742758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed0538-f45d-4f65-acc9-4e81039a2818 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.743534 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed0538-f45d-4f65-acc9-4e81039a2818 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:35.743832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed0538-f45d-4f65-acc9-4e81039a2818 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:35.769347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed0538-f45d-4f65-acc9-4e81039a2818 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:35.797843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 360/720] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Oct 27 13:57:35 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:35.803714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe9e8a-f673-41e9-8567-5f8ac6802efd admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:35.813511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe9e8a-f673-41e9-8567-5f8ac6802efd admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:35.817585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf47033-55c8-4317-8951-29f12d37e324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:35.818154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf47033-55c8-4317-8951-29f12d37e324 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.818442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf47033-55c8-4317-8951-29f12d37e324 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.818760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf47033-55c8-4317-8951-29f12d37e324 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.827286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf47033-55c8-4317-8951-29f12d37e324 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:35.853285 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf47033-55c8-4317-8951-29f12d37e324 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:35.863171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 361/721] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:57:35 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:57:35.868985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed0538-f45d-4f65-acc9-4e81039a2818 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:35.878926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed0538-f45d-4f65-acc9-4e81039a2818 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:35.883043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113eb87-8f59-4ff6-ac91-0a40778dadbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:35.883764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113eb87-8f59-4ff6-ac91-0a40778dadbe admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.884057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113eb87-8f59-4ff6-ac91-0a40778dadbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.884345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113eb87-8f59-4ff6-ac91-0a40778dadbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.896681 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113eb87-8f59-4ff6-ac91-0a40778dadbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:35.922332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113eb87-8f59-4ff6-ac91-0a40778dadbe admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:35.939834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-b113eb87-8f59-4ff6-ac91-0a40778dadbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:57:35.940940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 361/722] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:57:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:35.946553 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf47033-55c8-4317-8951-29f12d37e324 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:35.955884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf47033-55c8-4317-8951-29f12d37e324 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:35.959925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c64a2-8fe5-4d0b-987c-8e0890a38546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:35.960507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c64a2-8fe5-4d0b-987c-8e0890a38546 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:35.960799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c64a2-8fe5-4d0b-987c-8e0890a38546 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:35.961085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c64a2-8fe5-4d0b-987c-8e0890a38546 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:35.961761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c64a2-8fe5-4d0b-987c-8e0890a38546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:35.962063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c64a2-8fe5-4d0b-987c-8e0890a38546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:35.987954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c64a2-8fe5-4d0b-987c-8e0890a38546 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:36.007471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 362/723] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:57:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:36.008611 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113eb87-8f59-4ff6-ac91-0a40778dadbe admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:36.018737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113eb87-8f59-4ff6-ac91-0a40778dadbe admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:36.022726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f3e57-2231-44cc-9288-42a126791229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:36.023439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f3e57-2231-44cc-9288-42a126791229 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:36.023727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f3e57-2231-44cc-9288-42a126791229 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:36.024009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f3e57-2231-44cc-9288-42a126791229 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:36.033043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f3e57-2231-44cc-9288-42a126791229 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:36.058248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f3e57-2231-44cc-9288-42a126791229 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:36.078940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-239f3e57-2231-44cc-9288-42a126791229 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:57:36.079994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 362/724] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:57:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:57:36.085846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c64a2-8fe5-4d0b-987c-8e0890a38546 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:36.096160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c64a2-8fe5-4d0b-987c-8e0890a38546 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:36.101606 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d60b3-7c93-4f93-b6e4-c1eeae22358d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:36.102182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d60b3-7c93-4f93-b6e4-c1eeae22358d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:36.102466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d60b3-7c93-4f93-b6e4-c1eeae22358d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:36.102770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d60b3-7c93-4f93-b6e4-c1eeae22358d admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:36.103512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d60b3-7c93-4f93-b6e4-c1eeae22358d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:36.103810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d60b3-7c93-4f93-b6e4-c1eeae22358d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:36.129731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d60b3-7c93-4f93-b6e4-c1eeae22358d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:36.143236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 363/725] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:57:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:36.149212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f3e57-2231-44cc-9288-42a126791229 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:36.158758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f3e57-2231-44cc-9288-42a126791229 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:36.162724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9ef98-4cde-4697-a902-0c1161da8a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:36.163301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9ef98-4cde-4697-a902-0c1161da8a5f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:36.163593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9ef98-4cde-4697-a902-0c1161da8a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:36.163880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9ef98-4cde-4697-a902-0c1161da8a5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:36.164658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9ef98-4cde-4697-a902-0c1161da8a5f admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=3c014f6c51ed4c99a1a4450dde18cbef) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:36.164973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9ef98-4cde-4697-a902-0c1161da8a5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:36.190915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9ef98-4cde-4697-a902-0c1161da8a5f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:36.196675 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 363/726] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:57:36 2021] GET /identity/v3/role_assignments?user.id=3c014f6c51ed4c99a1a4450dde18cbef&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:38.162717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f63f8-b19b-4b0e-9455-18b62015e098 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:38.163267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f63f8-b19b-4b0e-9455-18b62015e098 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:38.163267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f63f8-b19b-4b0e-9455-18b62015e098 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:38.164946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 364/727] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:38.170204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780f83-60b1-4424-9007-a6ce485a115b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:38.170611 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780f83-60b1-4424-9007-a6ce485a115b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:38.170814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780f83-60b1-4424-9007-a6ce485a115b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:38.193287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-84780f83-60b1-4424-9007-a6ce485a115b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:38.194414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-84780f83-60b1-4424-9007-a6ce485a115b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:38.201588 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 364/728] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:38 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:38.222122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f63f8-b19b-4b0e-9455-18b62015e098 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:38.233976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f63f8-b19b-4b0e-9455-18b62015e098 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:38.238050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31123907-4bee-4d3e-b4ec-fc799bfe09e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:38.238810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31123907-4bee-4d3e-b4ec-fc799bfe09e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:38.239109 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31123907-4bee-4d3e-b4ec-fc799bfe09e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:38.239395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31123907-4bee-4d3e-b4ec-fc799bfe09e3 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:38.240015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31123907-4bee-4d3e-b4ec-fc799bfe09e3 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:38.266028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31123907-4bee-4d3e-b4ec-fc799bfe09e3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:38.276613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-31123907-4bee-4d3e-b4ec-fc799bfe09e3 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:57:38.277688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 365/729] 10.222.0.36 () {56 vars in 1150 bytes} [Wed Oct 27 13:57:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:38.283441 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780f83-60b1-4424-9007-a6ce485a115b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:38.291998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780f83-60b1-4424-9007-a6ce485a115b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:38.296126 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e906ca-05b0-415b-8120-d2a10542638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:38.296709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e906ca-05b0-415b-8120-d2a10542638b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:38.296993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e906ca-05b0-415b-8120-d2a10542638b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:38.297273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e906ca-05b0-415b-8120-d2a10542638b admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:38.297936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e906ca-05b0-415b-8120-d2a10542638b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:38.298237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e906ca-05b0-415b-8120-d2a10542638b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:38.323708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e906ca-05b0-415b-8120-d2a10542638b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:38.328769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 365/730] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Oct 27 13:57:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:38.334263 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31123907-4bee-4d3e-b4ec-fc799bfe09e3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:38.343675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31123907-4bee-4d3e-b4ec-fc799bfe09e3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:38.347606 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a89050-236c-42dc-a7b8-601135e7a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:38.348187 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a89050-236c-42dc-a7b8-601135e7a22b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:38.348479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a89050-236c-42dc-a7b8-601135e7a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:38.348765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a89050-236c-42dc-a7b8-601135e7a22b admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:38.349424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a89050-236c-42dc-a7b8-601135e7a22b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:38.349724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a89050-236c-42dc-a7b8-601135e7a22b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:38.375495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a89050-236c-42dc-a7b8-601135e7a22b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:38.379741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 366/731] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Oct 27 13:57:38 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:40.321819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980eb90-21f2-4af6-a5e1-41c4d9a4da5a None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:40.322332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980eb90-21f2-4af6-a5e1-41c4d9a4da5a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:40.322332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980eb90-21f2-4af6-a5e1-41c4d9a4da5a None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:40.324000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 366/732] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:40.329026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60c4d3-6fb7-4ff1-b532-2aad57458d4d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:40.329406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60c4d3-6fb7-4ff1-b532-2aad57458d4d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:40.329598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60c4d3-6fb7-4ff1-b532-2aad57458d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:40.351607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-1a60c4d3-6fb7-4ff1-b532-2aad57458d4d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:40.352870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1a60c4d3-6fb7-4ff1-b532-2aad57458d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:40.360077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 367/733] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:40 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:57:40.381288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980eb90-21f2-4af6-a5e1-41c4d9a4da5a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:40.392713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980eb90-21f2-4af6-a5e1-41c4d9a4da5a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:40.396572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a8f05-3707-4205-b6c7-24e006855fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:40.397146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8f05-3707-4205-b6c7-24e006855fbf admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:40.397440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8f05-3707-4205-b6c7-24e006855fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:40.397719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8f05-3707-4205-b6c7-24e006855fbf admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:40.398375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a8f05-3707-4205-b6c7-24e006855fbf admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:40.424413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a8f05-3707-4205-b6c7-24e006855fbf admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:40.437011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 367/734] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:57:40 2021] POST /identity/v3/services => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:57:42.425650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4fe4-ce2e-4118-a209-3e60f368e07b None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:42.426205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4fe4-ce2e-4118-a209-3e60f368e07b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:42.426205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4fe4-ce2e-4118-a209-3e60f368e07b None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:42.427927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 368/735] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:42.433133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca6be2-4428-4516-add6-e6b1a632827b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:42.434224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca6be2-4428-4516-add6-e6b1a632827b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:42.434356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca6be2-4428-4516-add6-e6b1a632827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:42.457877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1dca6be2-4428-4516-add6-e6b1a632827b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:42.459021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1dca6be2-4428-4516-add6-e6b1a632827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:42.475460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 368/736] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:42 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:42.498472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b4fe4-ce2e-4118-a209-3e60f368e07b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:42.509982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b4fe4-ce2e-4118-a209-3e60f368e07b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:42.513851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7991a0-e501-4133-bd12-095fe82248f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:42.514566 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7991a0-e501-4133-bd12-095fe82248f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:42.514879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7991a0-e501-4133-bd12-095fe82248f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:42.515156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7991a0-e501-4133-bd12-095fe82248f8 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:42.515768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7991a0-e501-4133-bd12-095fe82248f8 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:42.540655 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7991a0-e501-4133-bd12-095fe82248f8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:42.551875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-8e7991a0-e501-4133-bd12-095fe82248f8 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:57:42.552962 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 369/737] 10.222.0.36 () {56 vars in 1150 bytes} [Wed Oct 27 13:57:42 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:42.559771 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca6be2-4428-4516-add6-e6b1a632827b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:42.568307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca6be2-4428-4516-add6-e6b1a632827b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:42.572335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c474dc-7c84-47f3-a475-b46edb882fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:42.572919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c474dc-7c84-47f3-a475-b46edb882fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:42.573205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c474dc-7c84-47f3-a475-b46edb882fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:42.573488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c474dc-7c84-47f3-a475-b46edb882fa7 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:42.574316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c474dc-7c84-47f3-a475-b46edb882fa7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:42.574859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c474dc-7c84-47f3-a475-b46edb882fa7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:42.599818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c474dc-7c84-47f3-a475-b46edb882fa7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:42.604396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 369/738] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Oct 27 13:57:42 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:42.611001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7991a0-e501-4133-bd12-095fe82248f8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:42.620266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7991a0-e501-4133-bd12-095fe82248f8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:42.624916 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda82e11-a793-43ba-9ee0-aeec77b0aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:42.625500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82e11-a793-43ba-9ee0-aeec77b0aca2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:42.625793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82e11-a793-43ba-9ee0-aeec77b0aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:42.626080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda82e11-a793-43ba-9ee0-aeec77b0aca2 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:42.626786 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda82e11-a793-43ba-9ee0-aeec77b0aca2 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:42.627088 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda82e11-a793-43ba-9ee0-aeec77b0aca2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:42.651972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda82e11-a793-43ba-9ee0-aeec77b0aca2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:42.657195 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 370/739] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Oct 27 13:57:42 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:42.662885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c474dc-7c84-47f3-a475-b46edb882fa7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:42.672694 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c474dc-7c84-47f3-a475-b46edb882fa7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:42.676961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30a5f9-0a1e-4b76-87e8-7b7ddcd1ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:42.677489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30a5f9-0a1e-4b76-87e8-7b7ddcd1ca0a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:42.677781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30a5f9-0a1e-4b76-87e8-7b7ddcd1ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:42.678067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30a5f9-0a1e-4b76-87e8-7b7ddcd1ca0a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:42.678857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30a5f9-0a1e-4b76-87e8-7b7ddcd1ca0a admin admin] RBAC: Adding query filter params (interface=public, service_id=1f4c6fe56f11497dadf03a490a76ccd9, region_id=RegionOne) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:42.679167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30a5f9-0a1e-4b76-87e8-7b7ddcd1ca0a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:42.704227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30a5f9-0a1e-4b76-87e8-7b7ddcd1ca0a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:42.709725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 370/740] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Oct 27 13:57:42 2021] GET /identity/v3/endpoints?service_id=1f4c6fe56f11497dadf03a490a76ccd9&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:42.715598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda82e11-a793-43ba-9ee0-aeec77b0aca2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:42.724838 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda82e11-a793-43ba-9ee0-aeec77b0aca2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:42.728935 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b448895-e6af-4c23-8170-597fc7b1e9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:42.729517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448895-e6af-4c23-8170-597fc7b1e9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:42.729810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448895-e6af-4c23-8170-597fc7b1e9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:42.730096 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448895-e6af-4c23-8170-597fc7b1e9f8 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:42.731355 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b448895-e6af-4c23-8170-597fc7b1e9f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:42.756439 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b448895-e6af-4c23-8170-597fc7b1e9f8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:42.762125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 371/741] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 13:57:42 2021] GET /identity/v3/services => generated 1261 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:57:44.737414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d82a-1c7b-46f6-acd5-bf059d4a1524 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:44.737970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d82a-1c7b-46f6-acd5-bf059d4a1524 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:44.737970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d82a-1c7b-46f6-acd5-bf059d4a1524 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:44.739684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 371/742] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:44.744739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6f7e-763c-4ddf-9862-309ca1b2c31d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:44.745112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6f7e-763c-4ddf-9862-309ca1b2c31d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:44.745324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d6f7e-763c-4ddf-9862-309ca1b2c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:44.767885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-d49d6f7e-763c-4ddf-9862-309ca1b2c31d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:44.769006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d49d6f7e-763c-4ddf-9862-309ca1b2c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:44.775691 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 372/743] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:44 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:44.797999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d82a-1c7b-46f6-acd5-bf059d4a1524 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:44.810133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d82a-1c7b-46f6-acd5-bf059d4a1524 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:44.823232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f01f97-3099-419e-bfff-be629e01d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:44.823995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f01f97-3099-419e-bfff-be629e01d3fd admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:44.824289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f01f97-3099-419e-bfff-be629e01d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:44.824704 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f01f97-3099-419e-bfff-be629e01d3fd admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:44.825345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f01f97-3099-419e-bfff-be629e01d3fd admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:44.850111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f01f97-3099-419e-bfff-be629e01d3fd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:44.862220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e1f01f97-3099-419e-bfff-be629e01d3fd admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 13:57:44.863383 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 372/744] 10.222.0.36 () {56 vars in 1150 bytes} [Wed Oct 27 13:57:44 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:44.869286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6f7e-763c-4ddf-9862-309ca1b2c31d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:44.878567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d6f7e-763c-4ddf-9862-309ca1b2c31d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:44.882501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7059afa-a20f-4386-8024-c68bf2f3321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:44.883121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7059afa-a20f-4386-8024-c68bf2f3321c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:44.883462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7059afa-a20f-4386-8024-c68bf2f3321c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:44.883753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7059afa-a20f-4386-8024-c68bf2f3321c admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:44.884517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7059afa-a20f-4386-8024-c68bf2f3321c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:44.884833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7059afa-a20f-4386-8024-c68bf2f3321c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:44.911117 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7059afa-a20f-4386-8024-c68bf2f3321c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:44.915977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 373/745] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Oct 27 13:57:44 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:44.922307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f01f97-3099-419e-bfff-be629e01d3fd admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:44.931444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f01f97-3099-419e-bfff-be629e01d3fd admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:44.935706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cedd7-27c9-4ee3-8a67-097db529beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:44.936291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cedd7-27c9-4ee3-8a67-097db529beeb admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:44.936579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cedd7-27c9-4ee3-8a67-097db529beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:44.936861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cedd7-27c9-4ee3-8a67-097db529beeb admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:44.937527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cedd7-27c9-4ee3-8a67-097db529beeb admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:44.937829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cedd7-27c9-4ee3-8a67-097db529beeb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:44.963692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cedd7-27c9-4ee3-8a67-097db529beeb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:44.968989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 373/746] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Oct 27 13:57:44 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:44.974601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7059afa-a20f-4386-8024-c68bf2f3321c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:44.984593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7059afa-a20f-4386-8024-c68bf2f3321c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:44.988896 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e4b63-f5d8-4d1b-bc79-7f11e4b15878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:44.989414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e4b63-f5d8-4d1b-bc79-7f11e4b15878 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:44.989712 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e4b63-f5d8-4d1b-bc79-7f11e4b15878 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:44.989997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e4b63-f5d8-4d1b-bc79-7f11e4b15878 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:44.990707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e4b63-f5d8-4d1b-bc79-7f11e4b15878 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:45.015814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e4b63-f5d8-4d1b-bc79-7f11e4b15878 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:45.034303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 374/747] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 13:57:44 2021] POST /identity/v3/endpoints => generated 346 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:57:47.026208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e932f-3d1d-46ad-91d8-9f8819d86b58 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:47.026681 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e932f-3d1d-46ad-91d8-9f8819d86b58 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:47.026812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e932f-3d1d-46ad-91d8-9f8819d86b58 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:47.028827 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 374/748] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:47.033858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14379cab-c47f-4c35-9733-f574e7255b56 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:47.034244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14379cab-c47f-4c35-9733-f574e7255b56 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:47.034428 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14379cab-c47f-4c35-9733-f574e7255b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:47.056841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-14379cab-c47f-4c35-9733-f574e7255b56 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:47.057947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-14379cab-c47f-4c35-9733-f574e7255b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:47.075468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 375/749] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:47 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:47.096936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e932f-3d1d-46ad-91d8-9f8819d86b58 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:47.109174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e932f-3d1d-46ad-91d8-9f8819d86b58 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:47.113361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e91097-6551-41fa-945c-3b485012df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:47.114075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e91097-6551-41fa-945c-3b485012df34 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:47.114366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e91097-6551-41fa-945c-3b485012df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:47.114675 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e91097-6551-41fa-945c-3b485012df34 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:47.115294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e91097-6551-41fa-945c-3b485012df34 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:47.140737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e91097-6551-41fa-945c-3b485012df34 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:47.150994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-32e91097-6551-41fa-945c-3b485012df34 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Oct 27 13:57:47.152743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 375/750] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:47 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:47.158457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14379cab-c47f-4c35-9733-f574e7255b56 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:47.167033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14379cab-c47f-4c35-9733-f574e7255b56 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:47.171703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24a4f-e8cd-4c5c-b6fd-692f025e1166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:47.172277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24a4f-e8cd-4c5c-b6fd-692f025e1166 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:47.172638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24a4f-e8cd-4c5c-b6fd-692f025e1166 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:47.172849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24a4f-e8cd-4c5c-b6fd-692f025e1166 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:47.173516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24a4f-e8cd-4c5c-b6fd-692f025e1166 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:47.173814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24a4f-e8cd-4c5c-b6fd-692f025e1166 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:47.198834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb24a4f-e8cd-4c5c-b6fd-692f025e1166 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:47.203353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 376/751] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:47 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:47.208696 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e91097-6551-41fa-945c-3b485012df34 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:47.221426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e91097-6551-41fa-945c-3b485012df34 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:47.226120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3dbfb-ccbc-4e52-8238-9cdb5ae5d1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:47.226743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3dbfb-ccbc-4e52-8238-9cdb5ae5d1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:47.227033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3dbfb-ccbc-4e52-8238-9cdb5ae5d1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:47.227314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3dbfb-ccbc-4e52-8238-9cdb5ae5d1e7 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:47.227979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3dbfb-ccbc-4e52-8238-9cdb5ae5d1e7 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:47.228286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3dbfb-ccbc-4e52-8238-9cdb5ae5d1e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:47.254016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3dbfb-ccbc-4e52-8238-9cdb5ae5d1e7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:47.258617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 376/752] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:47 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:49.233218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdc9c6-7eb5-4a6b-86c0-0247fa355f2f None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:49.233768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdc9c6-7eb5-4a6b-86c0-0247fa355f2f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:49.233768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdc9c6-7eb5-4a6b-86c0-0247fa355f2f None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:49.235827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 377/753] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:49.241064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d15c0-73c8-4f1e-88b2-a52e8da5abd9 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:49.241484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d15c0-73c8-4f1e-88b2-a52e8da5abd9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:49.241631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d15c0-73c8-4f1e-88b2-a52e8da5abd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:49.266342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-177d15c0-73c8-4f1e-88b2-a52e8da5abd9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:49.267416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-177d15c0-73c8-4f1e-88b2-a52e8da5abd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:49.274131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 377/754] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:49 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:49.295974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdc9c6-7eb5-4a6b-86c0-0247fa355f2f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:49.307518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdc9c6-7eb5-4a6b-86c0-0247fa355f2f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:49.312179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838f67e-9cee-40fd-8530-826bb990f79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:49.312753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f67e-9cee-40fd-8530-826bb990f79c admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:49.313039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f67e-9cee-40fd-8530-826bb990f79c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:49.313319 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f67e-9cee-40fd-8530-826bb990f79c admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:49.313985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838f67e-9cee-40fd-8530-826bb990f79c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:49.339157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838f67e-9cee-40fd-8530-826bb990f79c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:49.352751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 378/755] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:57:49 2021] POST /identity/v3/services => generated 251 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:57:51.380706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62651b37-7b1e-4b45-9d87-065f867d6236 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:51.381240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62651b37-7b1e-4b45-9d87-065f867d6236 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:51.381240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62651b37-7b1e-4b45-9d87-065f867d6236 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:51.382962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 378/756] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:51.388772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70bf3b-2060-41e9-978e-713fe8bd8c8f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:51.389241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70bf3b-2060-41e9-978e-713fe8bd8c8f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:51.389327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70bf3b-2060-41e9-978e-713fe8bd8c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:51.411905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-bc70bf3b-2060-41e9-978e-713fe8bd8c8f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:51.413032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-bc70bf3b-2060-41e9-978e-713fe8bd8c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:51.429684 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 379/757] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:51 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:57:51.451875 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62651b37-7b1e-4b45-9d87-065f867d6236 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:51.463428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62651b37-7b1e-4b45-9d87-065f867d6236 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:51.468183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249573-afe8-4dd7-91f1-2aabff8d7c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:51.468902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249573-afe8-4dd7-91f1-2aabff8d7c4a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:51.469192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249573-afe8-4dd7-91f1-2aabff8d7c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:51.469474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249573-afe8-4dd7-91f1-2aabff8d7c4a admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:51.470096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6249573-afe8-4dd7-91f1-2aabff8d7c4a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:51.495231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6249573-afe8-4dd7-91f1-2aabff8d7c4a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:51.506144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-c6249573-afe8-4dd7-91f1-2aabff8d7c4a admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Oct 27 13:57:51.507302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 379/758] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:51 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:51.514347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70bf3b-2060-41e9-978e-713fe8bd8c8f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:51.523141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70bf3b-2060-41e9-978e-713fe8bd8c8f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:51.528260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30cb0-e967-432d-8ab3-e4b6f3f1841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:51.528857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30cb0-e967-432d-8ab3-e4b6f3f1841d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:51.529150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30cb0-e967-432d-8ab3-e4b6f3f1841d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:51.529436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30cb0-e967-432d-8ab3-e4b6f3f1841d admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:51.530123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e30cb0-e967-432d-8ab3-e4b6f3f1841d admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:51.530426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e30cb0-e967-432d-8ab3-e4b6f3f1841d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:51.555541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e30cb0-e967-432d-8ab3-e4b6f3f1841d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:51.560698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 380/759] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:51 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:51.566497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249573-afe8-4dd7-91f1-2aabff8d7c4a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:51.576309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249573-afe8-4dd7-91f1-2aabff8d7c4a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:51.580258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460382fc-c9cc-495f-aa82-a98d035b2dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:51.580837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460382fc-c9cc-495f-aa82-a98d035b2dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:51.581122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460382fc-c9cc-495f-aa82-a98d035b2dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:51.581404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460382fc-c9cc-495f-aa82-a98d035b2dd7 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:51.582064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460382fc-c9cc-495f-aa82-a98d035b2dd7 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:51.582361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460382fc-c9cc-495f-aa82-a98d035b2dd7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:51.607894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460382fc-c9cc-495f-aa82-a98d035b2dd7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:51.613226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 380/760] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:51 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:57:51.619246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30cb0-e967-432d-8ab3-e4b6f3f1841d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:51.630244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30cb0-e967-432d-8ab3-e4b6f3f1841d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:51.634444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3419ee-241c-45ef-8318-9144556b5120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:51.635000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3419ee-241c-45ef-8318-9144556b5120 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:51.635290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3419ee-241c-45ef-8318-9144556b5120 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:51.635580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3419ee-241c-45ef-8318-9144556b5120 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:51.637031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3419ee-241c-45ef-8318-9144556b5120 admin admin] RBAC: Adding query filter params (interface=public, service_id=6c01ed122ec04fc2bf469989838298b2, region_id=RegionOne) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:51.637577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3419ee-241c-45ef-8318-9144556b5120 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:51.662849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3419ee-241c-45ef-8318-9144556b5120 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:51.669284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 381/761] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Oct 27 13:57:51 2021] GET /identity/v3/endpoints?service_id=6c01ed122ec04fc2bf469989838298b2&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:51.675071 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460382fc-c9cc-495f-aa82-a98d035b2dd7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:51.685604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460382fc-c9cc-495f-aa82-a98d035b2dd7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:51.689809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b9108-53a1-4adb-a6c8-30a7b75c04ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:51.690417 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b9108-53a1-4adb-a6c8-30a7b75c04ee admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:51.690746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b9108-53a1-4adb-a6c8-30a7b75c04ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:51.691032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b9108-53a1-4adb-a6c8-30a7b75c04ee admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:51.691693 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b9108-53a1-4adb-a6c8-30a7b75c04ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:51.721013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b9108-53a1-4adb-a6c8-30a7b75c04ee admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:51.727511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 381/762] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 13:57:51 2021] GET /identity/v3/services => generated 1500 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:57:53.688465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571230c-04b5-444c-b26b-4aac1e8bfee7 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:53.689038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571230c-04b5-444c-b26b-4aac1e8bfee7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:53.689038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571230c-04b5-444c-b26b-4aac1e8bfee7 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:53.690732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 382/763] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:53.695859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5193c4d-356d-4418-95b1-3dfff369b14d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:53.696277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5193c4d-356d-4418-95b1-3dfff369b14d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:53.696438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5193c4d-356d-4418-95b1-3dfff369b14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:53.720529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c5193c4d-356d-4418-95b1-3dfff369b14d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:53.721668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c5193c4d-356d-4418-95b1-3dfff369b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:53.728472 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 382/764] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:53 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:53.750577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571230c-04b5-444c-b26b-4aac1e8bfee7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:53.762826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571230c-04b5-444c-b26b-4aac1e8bfee7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:53.766757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb084bc-bf8b-4033-8286-ccc18f37c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:53.767473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb084bc-bf8b-4033-8286-ccc18f37c9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:53.767762 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb084bc-bf8b-4033-8286-ccc18f37c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:53.768047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb084bc-bf8b-4033-8286-ccc18f37c9c0 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:53.768668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb084bc-bf8b-4033-8286-ccc18f37c9c0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:53.794227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb084bc-bf8b-4033-8286-ccc18f37c9c0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:53.804687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-7eb084bc-bf8b-4033-8286-ccc18f37c9c0 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Oct 27 13:57:53.805744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 383/765] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:53 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:53.811641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5193c4d-356d-4418-95b1-3dfff369b14d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:53.820204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5193c4d-356d-4418-95b1-3dfff369b14d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:53.824762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ea22-34ad-42e0-9df6-d14be956d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:53.825346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ea22-34ad-42e0-9df6-d14be956d7dc admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:53.825628 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ea22-34ad-42e0-9df6-d14be956d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:53.825907 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ea22-34ad-42e0-9df6-d14be956d7dc admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:53.826572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ea22-34ad-42e0-9df6-d14be956d7dc admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:53.826899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ea22-34ad-42e0-9df6-d14be956d7dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:53.852180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ea22-34ad-42e0-9df6-d14be956d7dc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:53.857238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 383/766] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:53 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:53.863262 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb084bc-bf8b-4033-8286-ccc18f37c9c0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:53.873120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb084bc-bf8b-4033-8286-ccc18f37c9c0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:53.877063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a195d52-ed9d-4db0-988a-4a1d1007f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:53.877646 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a195d52-ed9d-4db0-988a-4a1d1007f017 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:53.877933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a195d52-ed9d-4db0-988a-4a1d1007f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:53.878214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a195d52-ed9d-4db0-988a-4a1d1007f017 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:53.878907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a195d52-ed9d-4db0-988a-4a1d1007f017 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:53.879207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a195d52-ed9d-4db0-988a-4a1d1007f017 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:53.904992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a195d52-ed9d-4db0-988a-4a1d1007f017 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:53.910116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 384/767] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:53 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:53.915756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ea22-34ad-42e0-9df6-d14be956d7dc admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:53.925250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ea22-34ad-42e0-9df6-d14be956d7dc admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:53.929273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491b02e-dc74-4033-aa20-6d130c8970c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:53.929852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491b02e-dc74-4033-aa20-6d130c8970c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:53.930141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491b02e-dc74-4033-aa20-6d130c8970c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:53.930423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491b02e-dc74-4033-aa20-6d130c8970c5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:53.931155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491b02e-dc74-4033-aa20-6d130c8970c5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:53.957646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491b02e-dc74-4033-aa20-6d130c8970c5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:53.976582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 384/768] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 13:57:53 2021] POST /identity/v3/endpoints => generated 346 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:57:55.959175 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5323d-11cb-4970-a984-712242a2cf70 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:55.959700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5323d-11cb-4970-a984-712242a2cf70 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:55.959821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5323d-11cb-4970-a984-712242a2cf70 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:55.961410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 385/769] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:55.967281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ff6f3-c00f-4d96-ace4-79b6b395e418 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:55.967677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ff6f3-c00f-4d96-ace4-79b6b395e418 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:55.967854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ff6f3-c00f-4d96-ace4-79b6b395e418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:55.989935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-cd4ff6f3-c00f-4d96-ace4-79b6b395e418 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:55.991088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-cd4ff6f3-c00f-4d96-ace4-79b6b395e418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:56.008290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 385/770] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:55 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:56.030374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5323d-11cb-4970-a984-712242a2cf70 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:56.041666 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5323d-11cb-4970-a984-712242a2cf70 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:56.045476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c11ae-1d5c-4162-9a12-ff90b698b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:56.046186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c11ae-1d5c-4162-9a12-ff90b698b89c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:56.046474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c11ae-1d5c-4162-9a12-ff90b698b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:56.046786 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c11ae-1d5c-4162-9a12-ff90b698b89c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:56.047401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c11ae-1d5c-4162-9a12-ff90b698b89c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:56.072165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c11ae-1d5c-4162-9a12-ff90b698b89c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:56.082770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-6c4c11ae-1d5c-4162-9a12-ff90b698b89c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:57:56.083804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 386/771] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:57:56.090222 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ff6f3-c00f-4d96-ace4-79b6b395e418 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:56.098816 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ff6f3-c00f-4d96-ace4-79b6b395e418 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:56.102842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087da45-807a-4bae-9558-ff25433c9bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:56.103428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087da45-807a-4bae-9558-ff25433c9bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:56.103728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087da45-807a-4bae-9558-ff25433c9bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:56.104015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087da45-807a-4bae-9558-ff25433c9bf0 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:56.104685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087da45-807a-4bae-9558-ff25433c9bf0 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:56.104989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087da45-807a-4bae-9558-ff25433c9bf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:56.130838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087da45-807a-4bae-9558-ff25433c9bf0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:56.135488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 386/772] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:56.141648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c11ae-1d5c-4162-9a12-ff90b698b89c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:56.152400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c11ae-1d5c-4162-9a12-ff90b698b89c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:56.156561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2470f8-bfbe-4398-a798-80a4ff6310d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:56.157135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2470f8-bfbe-4398-a798-80a4ff6310d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:56.157427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2470f8-bfbe-4398-a798-80a4ff6310d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:56.157710 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2470f8-bfbe-4398-a798-80a4ff6310d8 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:56.158372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2470f8-bfbe-4398-a798-80a4ff6310d8 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:57:56.158781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2470f8-bfbe-4398-a798-80a4ff6310d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:56.184242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2470f8-bfbe-4398-a798-80a4ff6310d8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:56.188782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 387/773] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:57:56 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:57:58.132456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40467f-4c41-472b-aeaf-dde0f57e0c44 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:58.132965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40467f-4c41-472b-aeaf-dde0f57e0c44 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:58.133052 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40467f-4c41-472b-aeaf-dde0f57e0c44 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:58.134707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 387/774] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:57:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:57:58.140644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb27b2-9529-49d7-83bc-09c3f5ac85c9 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:58.141049 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb27b2-9529-49d7-83bc-09c3f5ac85c9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:58.141213 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb27b2-9529-49d7-83bc-09c3f5ac85c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:58.163956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-cacb27b2-9529-49d7-83bc-09c3f5ac85c9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:57:58.165090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cacb27b2-9529-49d7-83bc-09c3f5ac85c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:57:58.171950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 388/775] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:57:58 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:57:58.194042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40467f-4c41-472b-aeaf-dde0f57e0c44 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:57:58.206132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40467f-4c41-472b-aeaf-dde0f57e0c44 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:57:58.210016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305db67-6600-4484-a527-9e20b3f879f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:57:58.210604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305db67-6600-4484-a527-9e20b3f879f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:57:58.210955 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305db67-6600-4484-a527-9e20b3f879f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:57:58.211241 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305db67-6600-4484-a527-9e20b3f879f0 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:57:58.211908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305db67-6600-4484-a527-9e20b3f879f0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:57:58.237756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305db67-6600-4484-a527-9e20b3f879f0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:57:58.250258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 388/776] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:57:58 2021] POST /identity/v3/services => generated 251 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:58:00.242046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e943e-4b9f-403e-be23-a542c66dfedf None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:00.242564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e943e-4b9f-403e-be23-a542c66dfedf None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:00.242709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e943e-4b9f-403e-be23-a542c66dfedf None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:00.244313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 389/777] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:00.249428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a44c-e3a8-43a5-bad3-ee425a499e88 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:00.249826 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a44c-e3a8-43a5-bad3-ee425a499e88 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:00.250009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39a44c-e3a8-43a5-bad3-ee425a499e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:00.272881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7e39a44c-e3a8-43a5-bad3-ee425a499e88 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:00.273954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7e39a44c-e3a8-43a5-bad3-ee425a499e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:00.291415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 389/778] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:00 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:00.312896 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e943e-4b9f-403e-be23-a542c66dfedf None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:00.325021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e943e-4b9f-403e-be23-a542c66dfedf None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:00.328909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78334c66-206f-45b4-90c9-1171b6cc2697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:00.329619 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78334c66-206f-45b4-90c9-1171b6cc2697 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:00.329907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78334c66-206f-45b4-90c9-1171b6cc2697 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:00.330187 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78334c66-206f-45b4-90c9-1171b6cc2697 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:00.330840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78334c66-206f-45b4-90c9-1171b6cc2697 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:00.356583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78334c66-206f-45b4-90c9-1171b6cc2697 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:00.367124 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-78334c66-206f-45b4-90c9-1171b6cc2697 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:58:00.368172 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 390/779] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:58:00 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:00.374304 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39a44c-e3a8-43a5-bad3-ee425a499e88 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:00.382955 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39a44c-e3a8-43a5-bad3-ee425a499e88 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:00.387599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb9e62-35ca-46c4-ac80-2b4e20cf15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:00.388189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9e62-35ca-46c4-ac80-2b4e20cf15c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:00.388483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9e62-35ca-46c4-ac80-2b4e20cf15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:00.388779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9e62-35ca-46c4-ac80-2b4e20cf15c6 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:00.389450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb9e62-35ca-46c4-ac80-2b4e20cf15c6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:00.389753 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb9e62-35ca-46c4-ac80-2b4e20cf15c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:00.415196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb9e62-35ca-46c4-ac80-2b4e20cf15c6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:00.420131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 390/780] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:58:00 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:00.425603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78334c66-206f-45b4-90c9-1171b6cc2697 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:00.434919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78334c66-206f-45b4-90c9-1171b6cc2697 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:00.438905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa41461-46a7-49dd-8dcd-f32aee6c4f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:00.439478 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa41461-46a7-49dd-8dcd-f32aee6c4f21 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:00.439763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa41461-46a7-49dd-8dcd-f32aee6c4f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:00.440041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa41461-46a7-49dd-8dcd-f32aee6c4f21 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:00.440702 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa41461-46a7-49dd-8dcd-f32aee6c4f21 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:00.440999 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa41461-46a7-49dd-8dcd-f32aee6c4f21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:00.466392 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa41461-46a7-49dd-8dcd-f32aee6c4f21 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:00.471221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 391/781] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:58:00 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:00.477230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb9e62-35ca-46c4-ac80-2b4e20cf15c6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:00.487263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb9e62-35ca-46c4-ac80-2b4e20cf15c6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:00.491749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a70f9-28a4-400b-bbff-d030dfed3a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:00.492334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a70f9-28a4-400b-bbff-d030dfed3a65 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:00.492630 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a70f9-28a4-400b-bbff-d030dfed3a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:00.492917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a70f9-28a4-400b-bbff-d030dfed3a65 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:00.493659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a70f9-28a4-400b-bbff-d030dfed3a65 admin admin] RBAC: Adding query filter params (interface=public, service_id=9ff9bec269bf4973914ba2e758c8e327, region_id=RegionOne) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:00.493965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a70f9-28a4-400b-bbff-d030dfed3a65 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:00.519549 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a70f9-28a4-400b-bbff-d030dfed3a65 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:00.524932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 391/782] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Oct 27 13:58:00 2021] GET /identity/v3/endpoints?service_id=9ff9bec269bf4973914ba2e758c8e327&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:00.530416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa41461-46a7-49dd-8dcd-f32aee6c4f21 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:00.539727 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa41461-46a7-49dd-8dcd-f32aee6c4f21 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:00.544416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29785766-e1ff-4684-b634-9856f2f80c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:00.544991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29785766-e1ff-4684-b634-9856f2f80c12 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:00.545284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29785766-e1ff-4684-b634-9856f2f80c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:00.545576 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29785766-e1ff-4684-b634-9856f2f80c12 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:00.546220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29785766-e1ff-4684-b634-9856f2f80c12 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:00.571708 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29785766-e1ff-4684-b634-9856f2f80c12 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:00.578139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 392/783] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 13:58:00 2021] GET /identity/v3/services => generated 1739 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:58:02.518175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d406c7-0c7e-44a3-b8ab-2d88da3df66a None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:02.518755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d406c7-0c7e-44a3-b8ab-2d88da3df66a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:02.518755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d406c7-0c7e-44a3-b8ab-2d88da3df66a None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:02.520436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 392/784] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:02.525488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e49337-10a5-4090-8c8b-ebc6ae9290b0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:02.525908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e49337-10a5-4090-8c8b-ebc6ae9290b0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:02.526049 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e49337-10a5-4090-8c8b-ebc6ae9290b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:02.549387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e5e49337-10a5-4090-8c8b-ebc6ae9290b0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:02.550512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e5e49337-10a5-4090-8c8b-ebc6ae9290b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:02.558711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 393/785] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:02 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:02.580325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d406c7-0c7e-44a3-b8ab-2d88da3df66a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:02.592174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d406c7-0c7e-44a3-b8ab-2d88da3df66a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:02.596019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599146-6836-43cd-b1f8-519701e76696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:02.596733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599146-6836-43cd-b1f8-519701e76696 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:02.597025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599146-6836-43cd-b1f8-519701e76696 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:02.597306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599146-6836-43cd-b1f8-519701e76696 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:02.597917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b599146-6836-43cd-b1f8-519701e76696 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:02.625160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b599146-6836-43cd-b1f8-519701e76696 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:02.635847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-1b599146-6836-43cd-b1f8-519701e76696 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 13:58:02.637148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 393/786] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:58:02 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:02.643210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e49337-10a5-4090-8c8b-ebc6ae9290b0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:02.651892 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e49337-10a5-4090-8c8b-ebc6ae9290b0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:02.655941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ee490-0e5b-4944-9308-3148013f4b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:02.656524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ee490-0e5b-4944-9308-3148013f4b6d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:02.656815 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ee490-0e5b-4944-9308-3148013f4b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:02.657099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ee490-0e5b-4944-9308-3148013f4b6d admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:02.657763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ee490-0e5b-4944-9308-3148013f4b6d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:02.658063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ee490-0e5b-4944-9308-3148013f4b6d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:02.684526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ee490-0e5b-4944-9308-3148013f4b6d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:02.689287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 394/787] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:58:02 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:02.694919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599146-6836-43cd-b1f8-519701e76696 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:02.704243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599146-6836-43cd-b1f8-519701e76696 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:02.708302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf9306-145d-47e6-8a43-4b5efab00861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:02.708887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf9306-145d-47e6-8a43-4b5efab00861 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:02.709185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf9306-145d-47e6-8a43-4b5efab00861 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:02.709468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf9306-145d-47e6-8a43-4b5efab00861 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:02.710136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf9306-145d-47e6-8a43-4b5efab00861 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:02.710433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf9306-145d-47e6-8a43-4b5efab00861 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:02.736307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf9306-145d-47e6-8a43-4b5efab00861 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:02.740947 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 394/788] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:58:02 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:02.746975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ee490-0e5b-4944-9308-3148013f4b6d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:02.756176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ee490-0e5b-4944-9308-3148013f4b6d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:02.760197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057619a-7a65-4abd-a641-c0d7f8fde847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:02.760852 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057619a-7a65-4abd-a641-c0d7f8fde847 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:02.761143 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057619a-7a65-4abd-a641-c0d7f8fde847 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:02.761423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057619a-7a65-4abd-a641-c0d7f8fde847 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:02.762100 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057619a-7a65-4abd-a641-c0d7f8fde847 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:02.787158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057619a-7a65-4abd-a641-c0d7f8fde847 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:02.805521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 395/789] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 13:58:02 2021] POST /identity/v3/endpoints => generated 346 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:58:04.820524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c66b8-9815-4e46-a304-f48410aa6a79 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:04.821083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c66b8-9815-4e46-a304-f48410aa6a79 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:04.821083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c66b8-9815-4e46-a304-f48410aa6a79 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:04.822789 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 395/790] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:04.828561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0906e6f-9a64-4df2-bab0-c1c8f1428fb0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:04.828986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0906e6f-9a64-4df2-bab0-c1c8f1428fb0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:04.829196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0906e6f-9a64-4df2-bab0-c1c8f1428fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:04.851680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c0906e6f-9a64-4df2-bab0-c1c8f1428fb0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:04.852807 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c0906e6f-9a64-4df2-bab0-c1c8f1428fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:04.869743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 396/791] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:04 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:04.892735 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c66b8-9815-4e46-a304-f48410aa6a79 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:04.905196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c66b8-9815-4e46-a304-f48410aa6a79 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:04.909086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:04.909707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:04.910001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:04.910288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:04.911005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:04.936242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:04.937602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.common [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 13:58:04.956179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.sql.core [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 13:58:04.956179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 13:58:04.956179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [parameters: {'id': 'eb076c58f5e845db8c33238c913ddd98', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 13:58:04.956179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66091) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Oct 27 13:58:04.970865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb076c58f5e845db8c33238c913ddd98.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb076c58f5e845db8c33238c913ddd98. Oct 27 13:58:04.972127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 396/792] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Oct 27 13:58:04 2021] POST /identity/v3/projects => generated 262 bytes in 80 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:04.978168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0906e6f-9a64-4df2-bab0-c1c8f1428fb0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:04.987464 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0906e6f-9a64-4df2-bab0-c1c8f1428fb0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:04.991652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c53ff-1f69-486d-bd8c-f0c158626fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:04.992444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c53ff-1f69-486d-bd8c-f0c158626fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:04.992804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c53ff-1f69-486d-bd8c-f0c158626fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:04.993154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c53ff-1f69-486d-bd8c-f0c158626fc9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:05.001346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c53ff-1f69-486d-bd8c-f0c158626fc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:05.028657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c53ff-1f69-486d-bd8c-f0c158626fc9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:05.043388 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-d25c53ff-1f69-486d-bd8c-f0c158626fc9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:05.044479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 397/793] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:05.050699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:05.060266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99dfce-8599-4012-aee0-a8914f27078c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:05.064258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938258c-c66d-479b-a0dc-dd81b1a99367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:05.064835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938258c-c66d-479b-a0dc-dd81b1a99367 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:05.065124 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938258c-c66d-479b-a0dc-dd81b1a99367 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:05.065405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938258c-c66d-479b-a0dc-dd81b1a99367 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:05.066110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938258c-c66d-479b-a0dc-dd81b1a99367 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:05.066409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938258c-c66d-479b-a0dc-dd81b1a99367 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:05.092964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938258c-c66d-479b-a0dc-dd81b1a99367 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:05.109168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 397/794] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:58:05 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:07.089408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e18c3-540a-4426-94b8-5a28abc01ced None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:07.089965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e18c3-540a-4426-94b8-5a28abc01ced None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:07.090058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e18c3-540a-4426-94b8-5a28abc01ced None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:07.091744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 398/795] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:07.097118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7202c-0d9b-481f-8cc7-393d624aeb8d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:07.097528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7202c-0d9b-481f-8cc7-393d624aeb8d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:07.097694 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7202c-0d9b-481f-8cc7-393d624aeb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:07.120173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-dfa7202c-0d9b-481f-8cc7-393d624aeb8d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:07.121637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-dfa7202c-0d9b-481f-8cc7-393d624aeb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:07.128572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 398/796] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:07 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:07.154108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e18c3-540a-4426-94b8-5a28abc01ced None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:07.165758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e18c3-540a-4426-94b8-5a28abc01ced None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:07.169937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:07.170526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:07.170847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:07.171132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:07.171781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:07.197424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:07.199403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.common [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 13:58:07.210885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.sql.core [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 13:58:07.210885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 13:58:07.210885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [parameters: {'user_id': 'b0f2af95c71b43a3be15d0e3e314c61a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 13:58:07.210885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66092) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Oct 27 13:58:07.224417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 13:58:07.225653 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 399/797] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 13:58:07 2021] POST /identity/v3/users => generated 160 bytes in 72 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:07.231748 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7202c-0d9b-481f-8cc7-393d624aeb8d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:07.240723 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7202c-0d9b-481f-8cc7-393d624aeb8d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:07.244808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dccf8-bf47-4a31-86b8-90a8ea5406da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:07.245539 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dccf8-bf47-4a31-86b8-90a8ea5406da admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:07.245830 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dccf8-bf47-4a31-86b8-90a8ea5406da admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:07.246131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dccf8-bf47-4a31-86b8-90a8ea5406da admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:07.259196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dccf8-bf47-4a31-86b8-90a8ea5406da admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:07.285622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dccf8-bf47-4a31-86b8-90a8ea5406da admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:07.304049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e84dccf8-bf47-4a31-86b8-90a8ea5406da admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 13:58:07.305162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 399/798] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:58:07 2021] GET /identity/v3/users/cinder => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:07.313194 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:07.329317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361282b-2d75-4130-b9fd-6ea7a67fa90a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:07.333555 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5bec3-b704-4fb2-bbec-6549d414cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:07.334158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5bec3-b704-4fb2-bbec-6549d414cd62 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:07.334452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5bec3-b704-4fb2-bbec-6549d414cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:07.334776 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5bec3-b704-4fb2-bbec-6549d414cd62 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:07.335543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5bec3-b704-4fb2-bbec-6549d414cd62 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:07.335844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5bec3-b704-4fb2-bbec-6549d414cd62 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:07.362408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5bec3-b704-4fb2-bbec-6549d414cd62 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:07.396564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 400/799] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Oct 27 13:58:07 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:58:09.474764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1f60-1344-4022-9dbb-8c3585c88fb3 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:09.475317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1f60-1344-4022-9dbb-8c3585c88fb3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:09.475317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1f60-1344-4022-9dbb-8c3585c88fb3 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:09.477038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 400/800] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:09.482873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be2ca-f49e-4985-9410-17e252fb5bd7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:09.483290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be2ca-f49e-4985-9410-17e252fb5bd7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:09.483476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be2ca-f49e-4985-9410-17e252fb5bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:09.510013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6c7be2ca-f49e-4985-9410-17e252fb5bd7 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:09.511798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6c7be2ca-f49e-4985-9410-17e252fb5bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:09.519143 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 401/801] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:09 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:09.543348 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd1f60-1344-4022-9dbb-8c3585c88fb3 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:09.554866 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd1f60-1344-4022-9dbb-8c3585c88fb3 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:09.559520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a86b5-d91b-4d06-92ef-6c0f5e06aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:09.560236 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a86b5-d91b-4d06-92ef-6c0f5e06aed2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:09.560525 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a86b5-d91b-4d06-92ef-6c0f5e06aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:09.560805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a86b5-d91b-4d06-92ef-6c0f5e06aed2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:09.572878 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a86b5-d91b-4d06-92ef-6c0f5e06aed2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:09.598365 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a86b5-d91b-4d06-92ef-6c0f5e06aed2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:09.615889 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-0a4a86b5-d91b-4d06-92ef-6c0f5e06aed2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:09.616973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 401/802] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:09.623737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be2ca-f49e-4985-9410-17e252fb5bd7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:09.632235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be2ca-f49e-4985-9410-17e252fb5bd7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:09.636520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abecf-fc53-4831-8fdc-fdab5bae0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:09.637094 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abecf-fc53-4831-8fdc-fdab5bae0526 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:09.637382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abecf-fc53-4831-8fdc-fdab5bae0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:09.637672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abecf-fc53-4831-8fdc-fdab5bae0526 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:09.638338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abecf-fc53-4831-8fdc-fdab5bae0526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:09.638651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abecf-fc53-4831-8fdc-fdab5bae0526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:09.663949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abecf-fc53-4831-8fdc-fdab5bae0526 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:09.677041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 402/803] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:09.682668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a86b5-d91b-4d06-92ef-6c0f5e06aed2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:09.692041 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a86b5-d91b-4d06-92ef-6c0f5e06aed2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:09.696294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f779db9-685e-4c19-927a-a804387e262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:09.696889 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f779db9-685e-4c19-927a-a804387e262c admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:09.697182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f779db9-685e-4c19-927a-a804387e262c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:09.697469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f779db9-685e-4c19-927a-a804387e262c admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:09.698183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f779db9-685e-4c19-927a-a804387e262c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:09.724020 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f779db9-685e-4c19-927a-a804387e262c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:09.746100 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 402/804] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:58:09 2021] POST /identity/v3/users => generated 249 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:58:11.725501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e3c65-be8c-4cfe-9df6-8972f04fbda8 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:11.726130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e3c65-be8c-4cfe-9df6-8972f04fbda8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:11.726130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e3c65-be8c-4cfe-9df6-8972f04fbda8 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:11.727754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 403/805] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:11.733511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6f8d9-6fc4-4c94-b486-eb785b7ee745 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:11.733950 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6f8d9-6fc4-4c94-b486-eb785b7ee745 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:11.734093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6f8d9-6fc4-4c94-b486-eb785b7ee745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:11.758524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-61c6f8d9-6fc4-4c94-b486-eb785b7ee745 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:11.759692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-61c6f8d9-6fc4-4c94-b486-eb785b7ee745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:11.766684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 403/806] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:11 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:11.789211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e3c65-be8c-4cfe-9df6-8972f04fbda8 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:11.801387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e3c65-be8c-4cfe-9df6-8972f04fbda8 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:11.805443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e70a2-69d8-4477-9db3-48b09deabb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:11.806150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e70a2-69d8-4477-9db3-48b09deabb94 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:11.806444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e70a2-69d8-4477-9db3-48b09deabb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:11.806767 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e70a2-69d8-4477-9db3-48b09deabb94 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:11.818698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e70a2-69d8-4477-9db3-48b09deabb94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:11.825206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-0c1e70a2-69d8-4477-9db3-48b09deabb94 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:58:11.826333 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 404/807] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:58:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:11.832502 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6f8d9-6fc4-4c94-b486-eb785b7ee745 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:11.841811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6f8d9-6fc4-4c94-b486-eb785b7ee745 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:11.845874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb6ccf-2aed-4fe7-a1d6-421de4d3985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:11.846461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6ccf-2aed-4fe7-a1d6-421de4d3985c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:11.846793 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6ccf-2aed-4fe7-a1d6-421de4d3985c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:11.847071 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6ccf-2aed-4fe7-a1d6-421de4d3985c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:11.847777 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb6ccf-2aed-4fe7-a1d6-421de4d3985c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:11.848073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb6ccf-2aed-4fe7-a1d6-421de4d3985c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:11.875140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb6ccf-2aed-4fe7-a1d6-421de4d3985c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:11.884009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 404/808] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:58:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:11.890063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e70a2-69d8-4477-9db3-48b09deabb94 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:11.899936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e70a2-69d8-4477-9db3-48b09deabb94 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:11.904704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339bae6-57bf-4eb9-bcf6-fb5d41780f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:11.905420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339bae6-57bf-4eb9-bcf6-fb5d41780f2d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:11.905713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339bae6-57bf-4eb9-bcf6-fb5d41780f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:11.905998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339bae6-57bf-4eb9-bcf6-fb5d41780f2d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:11.917699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339bae6-57bf-4eb9-bcf6-fb5d41780f2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:11.943815 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339bae6-57bf-4eb9-bcf6-fb5d41780f2d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:11.961717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-4339bae6-57bf-4eb9-bcf6-fb5d41780f2d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:11.962834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 405/809] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:11.969273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb6ccf-2aed-4fe7-a1d6-421de4d3985c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:11.978552 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb6ccf-2aed-4fe7-a1d6-421de4d3985c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:11.983157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b499bc-ad38-445e-bc65-814d4a645dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:11.983745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b499bc-ad38-445e-bc65-814d4a645dee admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:11.984039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b499bc-ad38-445e-bc65-814d4a645dee admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:11.984326 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b499bc-ad38-445e-bc65-814d4a645dee admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:11.985267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b499bc-ad38-445e-bc65-814d4a645dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:11.985575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b499bc-ad38-445e-bc65-814d4a645dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:12.011710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b499bc-ad38-445e-bc65-814d4a645dee admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:12.025386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 405/810] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:12.031781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339bae6-57bf-4eb9-bcf6-fb5d41780f2d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:12.041085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339bae6-57bf-4eb9-bcf6-fb5d41780f2d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:12.045969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43cc32-70e5-4149-829d-73772fb95225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:12.046717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43cc32-70e5-4149-829d-73772fb95225 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:12.047012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43cc32-70e5-4149-829d-73772fb95225 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:12.047300 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43cc32-70e5-4149-829d-73772fb95225 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:12.060038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43cc32-70e5-4149-829d-73772fb95225 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:12.085821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43cc32-70e5-4149-829d-73772fb95225 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:12.105871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-aa43cc32-70e5-4149-829d-73772fb95225 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 13:58:12.106992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 406/811] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:58:12 2021] GET /identity/v3/users/neutron => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:12.113001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b499bc-ad38-445e-bc65-814d4a645dee admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:12.122299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b499bc-ad38-445e-bc65-814d4a645dee admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:12.126379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a8380-5b5f-4f5b-b3c8-f265fe374b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:12.127035 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a8380-5b5f-4f5b-b3c8-f265fe374b98 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:12.127329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a8380-5b5f-4f5b-b3c8-f265fe374b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:12.127612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a8380-5b5f-4f5b-b3c8-f265fe374b98 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:12.128396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a8380-5b5f-4f5b-b3c8-f265fe374b98 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:12.128699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a8380-5b5f-4f5b-b3c8-f265fe374b98 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:12.154498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a8380-5b5f-4f5b-b3c8-f265fe374b98 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:12.183948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 406/812] 10.222.0.36 () {56 vars in 1160 bytes} [Wed Oct 27 13:58:12 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:12.189698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43cc32-70e5-4149-829d-73772fb95225 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:12.199117 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43cc32-70e5-4149-829d-73772fb95225 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:12.203339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca667-fd02-472f-b671-6ebd5fd73d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:12.203918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca667-fd02-472f-b671-6ebd5fd73d07 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:12.204199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca667-fd02-472f-b671-6ebd5fd73d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:12.204486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca667-fd02-472f-b671-6ebd5fd73d07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:12.212149 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ca667-fd02-472f-b671-6ebd5fd73d07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:12.238953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ca667-fd02-472f-b671-6ebd5fd73d07 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:12.248398 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 407/813] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:58:12 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 13:58:12.254197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a8380-5b5f-4f5b-b3c8-f265fe374b98 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:12.264511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a8380-5b5f-4f5b-b3c8-f265fe374b98 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:12.268613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f5f4c-973a-4f9d-8d92-0ab54ddd33c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:12.269329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f5f4c-973a-4f9d-8d92-0ab54ddd33c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:12.269621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f5f4c-973a-4f9d-8d92-0ab54ddd33c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:12.269904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f5f4c-973a-4f9d-8d92-0ab54ddd33c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:12.281900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f5f4c-973a-4f9d-8d92-0ab54ddd33c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:12.307346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f5f4c-973a-4f9d-8d92-0ab54ddd33c6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:12.324642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-bf3f5f4c-973a-4f9d-8d92-0ab54ddd33c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:12.325724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 407/814] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:12.331418 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca667-fd02-472f-b671-6ebd5fd73d07 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:12.340628 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca667-fd02-472f-b671-6ebd5fd73d07 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:12.344734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5fcaa-fdba-440c-99ec-073cc0ecd52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:12.345317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5fcaa-fdba-440c-99ec-073cc0ecd52d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:12.345610 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5fcaa-fdba-440c-99ec-073cc0ecd52d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:12.345893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5fcaa-fdba-440c-99ec-073cc0ecd52d admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:12.346575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5fcaa-fdba-440c-99ec-073cc0ecd52d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:12.346912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5fcaa-fdba-440c-99ec-073cc0ecd52d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:12.372529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5fcaa-fdba-440c-99ec-073cc0ecd52d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:12.386501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 408/815] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:12.392172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f5f4c-973a-4f9d-8d92-0ab54ddd33c6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:12.402235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f5f4c-973a-4f9d-8d92-0ab54ddd33c6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:12.406260 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9f295-af3f-4317-a608-aebb36f19ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:12.407004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9f295-af3f-4317-a608-aebb36f19ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:12.407292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9f295-af3f-4317-a608-aebb36f19ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:12.407573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9f295-af3f-4317-a608-aebb36f19ad3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:12.416420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9f295-af3f-4317-a608-aebb36f19ad3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:12.441816 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9f295-af3f-4317-a608-aebb36f19ad3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:12.455677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-bba9f295-af3f-4317-a608-aebb36f19ad3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:12.456739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 408/816] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:12.462517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5fcaa-fdba-440c-99ec-073cc0ecd52d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:12.472619 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5fcaa-fdba-440c-99ec-073cc0ecd52d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:12.476852 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc35f0-2049-4844-a514-576acecf6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:12.477435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc35f0-2049-4844-a514-576acecf6852 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:12.477729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc35f0-2049-4844-a514-576acecf6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:12.478016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc35f0-2049-4844-a514-576acecf6852 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:12.478804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc35f0-2049-4844-a514-576acecf6852 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:12.479121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc35f0-2049-4844-a514-576acecf6852 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:12.504894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc35f0-2049-4844-a514-576acecf6852 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:12.519016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 409/817] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:58:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:12.525045 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9f295-af3f-4317-a608-aebb36f19ad3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:12.534853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9f295-af3f-4317-a608-aebb36f19ad3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:12.538862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1bc1b-9652-4d23-a04f-8fdb7d638476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:12.539438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1bc1b-9652-4d23-a04f-8fdb7d638476 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:12.539726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1bc1b-9652-4d23-a04f-8fdb7d638476 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:12.540007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1bc1b-9652-4d23-a04f-8fdb7d638476 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:12.540784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1bc1b-9652-4d23-a04f-8fdb7d638476 admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=dea5ec2125f0468baa1e15a429021e0c) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:12.541087 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1bc1b-9652-4d23-a04f-8fdb7d638476 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:12.566207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1bc1b-9652-4d23-a04f-8fdb7d638476 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:12.571684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 409/818] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:58:12 2021] GET /identity/v3/role_assignments?user.id=dea5ec2125f0468baa1e15a429021e0c&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:14.526521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabc7bd-7aa8-4cf4-b46d-59b6b8750aab None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:14.527105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabc7bd-7aa8-4cf4-b46d-59b6b8750aab None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:14.527105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabc7bd-7aa8-4cf4-b46d-59b6b8750aab None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:14.528769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 410/819] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:14.533919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c129c74-9333-4a92-a978-a2c1e6d3997a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:14.534296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c129c74-9333-4a92-a978-a2c1e6d3997a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:14.534496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c129c74-9333-4a92-a978-a2c1e6d3997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:14.557829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-5c129c74-9333-4a92-a978-a2c1e6d3997a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:14.558987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5c129c74-9333-4a92-a978-a2c1e6d3997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:14.565684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 410/820] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:14 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:14.587851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabc7bd-7aa8-4cf4-b46d-59b6b8750aab None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:14.599648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabc7bd-7aa8-4cf4-b46d-59b6b8750aab None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:14.603547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248e5b4-5582-4f6c-8506-a173df69e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:14.604768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248e5b4-5582-4f6c-8506-a173df69e515 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:14.605136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248e5b4-5582-4f6c-8506-a173df69e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:14.605422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248e5b4-5582-4f6c-8506-a173df69e515 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:14.616970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248e5b4-5582-4f6c-8506-a173df69e515 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:14.623887 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-0248e5b4-5582-4f6c-8506-a173df69e515 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:58:14.624995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 411/821] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:58:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:14.630979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c129c74-9333-4a92-a978-a2c1e6d3997a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:14.639570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c129c74-9333-4a92-a978-a2c1e6d3997a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:14.643620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e152-6ddd-46a6-9ee6-579cda89ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:14.644212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e152-6ddd-46a6-9ee6-579cda89ed7c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:14.644503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e152-6ddd-46a6-9ee6-579cda89ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:14.644788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e152-6ddd-46a6-9ee6-579cda89ed7c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:14.645494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063e152-6ddd-46a6-9ee6-579cda89ed7c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:14.645794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063e152-6ddd-46a6-9ee6-579cda89ed7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:14.671299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063e152-6ddd-46a6-9ee6-579cda89ed7c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:14.679663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 411/822] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:58:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:14.685748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248e5b4-5582-4f6c-8506-a173df69e515 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:14.695560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248e5b4-5582-4f6c-8506-a173df69e515 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:14.700532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf60e25-47a0-469d-a13b-0a3ed633b886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:14.701239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf60e25-47a0-469d-a13b-0a3ed633b886 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:14.701540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf60e25-47a0-469d-a13b-0a3ed633b886 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:14.701829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf60e25-47a0-469d-a13b-0a3ed633b886 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:14.712898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf60e25-47a0-469d-a13b-0a3ed633b886 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:14.739028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf60e25-47a0-469d-a13b-0a3ed633b886 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:14.756954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-5cf60e25-47a0-469d-a13b-0a3ed633b886 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:14.758019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 412/823] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:14.763704 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e152-6ddd-46a6-9ee6-579cda89ed7c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:14.772897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e152-6ddd-46a6-9ee6-579cda89ed7c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:14.777199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b907d-747f-43d4-a8d7-431c38f07c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:14.777724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b907d-747f-43d4-a8d7-431c38f07c08 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:14.778016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b907d-747f-43d4-a8d7-431c38f07c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:14.778301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b907d-747f-43d4-a8d7-431c38f07c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:14.779021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b907d-747f-43d4-a8d7-431c38f07c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:14.779324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b907d-747f-43d4-a8d7-431c38f07c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:14.804767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b907d-747f-43d4-a8d7-431c38f07c08 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:14.818725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 412/824] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:14.824558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf60e25-47a0-469d-a13b-0a3ed633b886 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:14.833982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf60e25-47a0-469d-a13b-0a3ed633b886 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:14.838232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639ed66-11ba-4e9c-967b-e7ddda598b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:14.839339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639ed66-11ba-4e9c-967b-e7ddda598b61 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:14.839631 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639ed66-11ba-4e9c-967b-e7ddda598b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:14.839914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639ed66-11ba-4e9c-967b-e7ddda598b61 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:14.854857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639ed66-11ba-4e9c-967b-e7ddda598b61 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:14.881287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639ed66-11ba-4e9c-967b-e7ddda598b61 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:14.899659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-1639ed66-11ba-4e9c-967b-e7ddda598b61 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 13:58:14.901250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 413/825] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:58:14 2021] GET /identity/v3/users/neutron => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:14.907489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b907d-747f-43d4-a8d7-431c38f07c08 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:14.917893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b907d-747f-43d4-a8d7-431c38f07c08 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:14.922159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf902853-9068-4f4c-9757-f62e27d6f0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:14.922783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902853-9068-4f4c-9757-f62e27d6f0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:14.923072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902853-9068-4f4c-9757-f62e27d6f0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:14.923351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902853-9068-4f4c-9757-f62e27d6f0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:14.924232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf902853-9068-4f4c-9757-f62e27d6f0e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:14.924619 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf902853-9068-4f4c-9757-f62e27d6f0e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:14.950665 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf902853-9068-4f4c-9757-f62e27d6f0e0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:14.981204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 413/826] 10.222.0.36 () {56 vars in 1160 bytes} [Wed Oct 27 13:58:14 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:14.987022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639ed66-11ba-4e9c-967b-e7ddda598b61 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:14.996212 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639ed66-11ba-4e9c-967b-e7ddda598b61 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:15.000168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b8520-45d1-4a1c-a548-c6acd1f87815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:15.000871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b8520-45d1-4a1c-a548-c6acd1f87815 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:15.001157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b8520-45d1-4a1c-a548-c6acd1f87815 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:15.001437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b8520-45d1-4a1c-a548-c6acd1f87815 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:15.013632 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b8520-45d1-4a1c-a548-c6acd1f87815 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:15.039324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b8520-45d1-4a1c-a548-c6acd1f87815 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:15.056814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-e26b8520-45d1-4a1c-a548-c6acd1f87815 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:15.057937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 414/827] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:15.063649 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf902853-9068-4f4c-9757-f62e27d6f0e0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:15.073202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf902853-9068-4f4c-9757-f62e27d6f0e0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:15.077278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723101d-aa61-46e5-b282-80d100c08387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:15.077869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723101d-aa61-46e5-b282-80d100c08387 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:15.078166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723101d-aa61-46e5-b282-80d100c08387 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:15.078453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723101d-aa61-46e5-b282-80d100c08387 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:15.079178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723101d-aa61-46e5-b282-80d100c08387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:15.079483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723101d-aa61-46e5-b282-80d100c08387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:15.105701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723101d-aa61-46e5-b282-80d100c08387 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:15.118684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 414/828] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:15.124384 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b8520-45d1-4a1c-a548-c6acd1f87815 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:15.133769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b8520-45d1-4a1c-a548-c6acd1f87815 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:15.138364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359a698-cda6-4fce-80da-20522c74a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:15.139437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359a698-cda6-4fce-80da-20522c74a395 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:15.139858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359a698-cda6-4fce-80da-20522c74a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:15.140145 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359a698-cda6-4fce-80da-20522c74a395 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:15.149073 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359a698-cda6-4fce-80da-20522c74a395 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:15.175475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359a698-cda6-4fce-80da-20522c74a395 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:15.188865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-c359a698-cda6-4fce-80da-20522c74a395 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:15.189933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 415/829] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:15.196173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723101d-aa61-46e5-b282-80d100c08387 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:15.205494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723101d-aa61-46e5-b282-80d100c08387 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:15.209690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d011b5-88df-4b15-886b-58e9a22f6c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:15.210273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d011b5-88df-4b15-886b-58e9a22f6c97 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:15.210562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d011b5-88df-4b15-886b-58e9a22f6c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:15.210872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d011b5-88df-4b15-886b-58e9a22f6c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:15.211608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d011b5-88df-4b15-886b-58e9a22f6c97 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:15.211911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d011b5-88df-4b15-886b-58e9a22f6c97 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:15.238531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d011b5-88df-4b15-886b-58e9a22f6c97 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:15.251444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 415/830] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:58:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:58:15.257468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359a698-cda6-4fce-80da-20522c74a395 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:15.267313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359a698-cda6-4fce-80da-20522c74a395 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:15.271372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1844c6-2e1c-4034-87e5-20052e926c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:15.272179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1844c6-2e1c-4034-87e5-20052e926c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:15.272467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1844c6-2e1c-4034-87e5-20052e926c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:15.272749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1844c6-2e1c-4034-87e5-20052e926c91 admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/dea5ec2125f0468baa1e15a429021e0c/roles/18aaf45888374560a4c11e1912d42c97` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:15.293779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1844c6-2e1c-4034-87e5-20052e926c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=dea5ec2125f0468baa1e15a429021e0c, role_id=18aaf45888374560a4c11e1912d42c97)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:15.320168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1844c6-2e1c-4034-87e5-20052e926c91 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:15.333721 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 416/831] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:58:15 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/dea5ec2125f0468baa1e15a429021e0c/roles/18aaf45888374560a4c11e1912d42c97 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:58:17.301488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee62f7e-a39d-4cbd-a9e2-be0689166695 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.301990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee62f7e-a39d-4cbd-a9e2-be0689166695 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.301990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee62f7e-a39d-4cbd-a9e2-be0689166695 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.303656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 416/832] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:17.308860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e2946-94bb-4bd7-9a84-a67a5df4f892 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.309284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e2946-94bb-4bd7-9a84-a67a5df4f892 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.309421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e2946-94bb-4bd7-9a84-a67a5df4f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.331553 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-343e2946-94bb-4bd7-9a84-a67a5df4f892 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:17.332701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-343e2946-94bb-4bd7-9a84-a67a5df4f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:17.396452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 417/833] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:17 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:17.419913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee62f7e-a39d-4cbd-a9e2-be0689166695 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:17.432511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee62f7e-a39d-4cbd-a9e2-be0689166695 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:17.436676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4713eae-85ab-47ae-b4a2-36f8901a25b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:17.437393 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4713eae-85ab-47ae-b4a2-36f8901a25b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.437681 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4713eae-85ab-47ae-b4a2-36f8901a25b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.437961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4713eae-85ab-47ae-b4a2-36f8901a25b1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.449301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4713eae-85ab-47ae-b4a2-36f8901a25b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:17.455464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-f4713eae-85ab-47ae-b4a2-36f8901a25b1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:58:17.456572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 417/834] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:58:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:17.462608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e2946-94bb-4bd7-9a84-a67a5df4f892 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:17.471953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e2946-94bb-4bd7-9a84-a67a5df4f892 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:17.476038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020c9d0-00e2-49da-a2fc-fffff8ba1d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:17.476630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020c9d0-00e2-49da-a2fc-fffff8ba1d6d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.476923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020c9d0-00e2-49da-a2fc-fffff8ba1d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.477211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020c9d0-00e2-49da-a2fc-fffff8ba1d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.477919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020c9d0-00e2-49da-a2fc-fffff8ba1d6d admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:17.478222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020c9d0-00e2-49da-a2fc-fffff8ba1d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:17.504363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020c9d0-00e2-49da-a2fc-fffff8ba1d6d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:17.513753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 418/835] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:58:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:17.519544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4713eae-85ab-47ae-b4a2-36f8901a25b1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:17.531954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4713eae-85ab-47ae-b4a2-36f8901a25b1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:17.536017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a0d03-c650-4f39-88cc-3a88577a8e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:17.536722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a0d03-c650-4f39-88cc-3a88577a8e1b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.537007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a0d03-c650-4f39-88cc-3a88577a8e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.537287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a0d03-c650-4f39-88cc-3a88577a8e1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.548343 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a0d03-c650-4f39-88cc-3a88577a8e1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:17.573800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a0d03-c650-4f39-88cc-3a88577a8e1b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:17.591476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-859a0d03-c650-4f39-88cc-3a88577a8e1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:17.592549 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 418/836] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:17.598365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020c9d0-00e2-49da-a2fc-fffff8ba1d6d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:17.609489 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020c9d0-00e2-49da-a2fc-fffff8ba1d6d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:17.613974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fe58-9c5f-4e8a-9acd-4fcf1f96ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:17.614564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fe58-9c5f-4e8a-9acd-4fcf1f96ef60 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.614895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fe58-9c5f-4e8a-9acd-4fcf1f96ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.615181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fe58-9c5f-4e8a-9acd-4fcf1f96ef60 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.615864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524fe58-9c5f-4e8a-9acd-4fcf1f96ef60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:17.616168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524fe58-9c5f-4e8a-9acd-4fcf1f96ef60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:17.642289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524fe58-9c5f-4e8a-9acd-4fcf1f96ef60 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:17.655958 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 419/837] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:17.661558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a0d03-c650-4f39-88cc-3a88577a8e1b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:17.670866 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a0d03-c650-4f39-88cc-3a88577a8e1b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:17.674855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f70c-a0f5-4102-9ef2-39a2a18bad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:17.675566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f70c-a0f5-4102-9ef2-39a2a18bad95 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.675854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f70c-a0f5-4102-9ef2-39a2a18bad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.676136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f70c-a0f5-4102-9ef2-39a2a18bad95 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.688546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f70c-a0f5-4102-9ef2-39a2a18bad95 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:17.714809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f70c-a0f5-4102-9ef2-39a2a18bad95 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:17.735423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-79d4f70c-a0f5-4102-9ef2-39a2a18bad95 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 13:58:17.736538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 419/838] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:58:17 2021] GET /identity/v3/users/neutron => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:17.742284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fe58-9c5f-4e8a-9acd-4fcf1f96ef60 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:17.752264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fe58-9c5f-4e8a-9acd-4fcf1f96ef60 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:17.756325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694d69a-128e-47d0-b802-ce1fa85e8e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:17.756918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694d69a-128e-47d0-b802-ce1fa85e8e31 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.757212 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694d69a-128e-47d0-b802-ce1fa85e8e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.757499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694d69a-128e-47d0-b802-ce1fa85e8e31 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.758284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694d69a-128e-47d0-b802-ce1fa85e8e31 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:17.758586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694d69a-128e-47d0-b802-ce1fa85e8e31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:17.784324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694d69a-128e-47d0-b802-ce1fa85e8e31 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:17.814808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 420/839] 10.222.0.36 () {56 vars in 1160 bytes} [Wed Oct 27 13:58:17 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:17.820636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f70c-a0f5-4102-9ef2-39a2a18bad95 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:17.830385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f70c-a0f5-4102-9ef2-39a2a18bad95 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:17.834570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f729db-bc56-4a5d-b9d7-7daac7efc4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:17.835184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f729db-bc56-4a5d-b9d7-7daac7efc4ec admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.835478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f729db-bc56-4a5d-b9d7-7daac7efc4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.835767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f729db-bc56-4a5d-b9d7-7daac7efc4ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.844227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f729db-bc56-4a5d-b9d7-7daac7efc4ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:17.871612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f729db-bc56-4a5d-b9d7-7daac7efc4ec admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:17.881478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 420/840] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:58:17 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:58:17.888221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694d69a-128e-47d0-b802-ce1fa85e8e31 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:17.897623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694d69a-128e-47d0-b802-ce1fa85e8e31 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:17.902488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37396-c393-42d2-8fd1-5982c72545eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:17.903376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37396-c393-42d2-8fd1-5982c72545eb admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.903552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37396-c393-42d2-8fd1-5982c72545eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.903859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37396-c393-42d2-8fd1-5982c72545eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.915333 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc37396-c393-42d2-8fd1-5982c72545eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:17.941670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc37396-c393-42d2-8fd1-5982c72545eb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:17.958724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-ecc37396-c393-42d2-8fd1-5982c72545eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:17.959817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 421/841] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:58:17.965995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f729db-bc56-4a5d-b9d7-7daac7efc4ec admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:17.974999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f729db-bc56-4a5d-b9d7-7daac7efc4ec admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:17.979768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4380f0-a196-46f5-ac9d-7cc4c3cc93b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:17.980354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4380f0-a196-46f5-ac9d-7cc4c3cc93b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:17.980645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4380f0-a196-46f5-ac9d-7cc4c3cc93b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:17.980932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4380f0-a196-46f5-ac9d-7cc4c3cc93b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:17.981617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4380f0-a196-46f5-ac9d-7cc4c3cc93b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:17.981920 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4380f0-a196-46f5-ac9d-7cc4c3cc93b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:18.007116 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4380f0-a196-46f5-ac9d-7cc4c3cc93b0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:18.020516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 421/842] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:18.027076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37396-c393-42d2-8fd1-5982c72545eb admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:18.036613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37396-c393-42d2-8fd1-5982c72545eb admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:18.040699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0fe94-8b86-4122-8642-d2ee24a7df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:18.041985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0fe94-8b86-4122-8642-d2ee24a7df17 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:18.042274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0fe94-8b86-4122-8642-d2ee24a7df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:18.042559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0fe94-8b86-4122-8642-d2ee24a7df17 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:18.051529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0fe94-8b86-4122-8642-d2ee24a7df17 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:18.077095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0fe94-8b86-4122-8642-d2ee24a7df17 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:18.091895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-8fa0fe94-8b86-4122-8642-d2ee24a7df17 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:18.092955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 422/843] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:18.099710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4380f0-a196-46f5-ac9d-7cc4c3cc93b0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:18.114738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4380f0-a196-46f5-ac9d-7cc4c3cc93b0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:18.118842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbd474-b23f-47c0-8310-087f73b6334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:18.119458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbd474-b23f-47c0-8310-087f73b6334f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:18.119904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbd474-b23f-47c0-8310-087f73b6334f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:18.120190 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbd474-b23f-47c0-8310-087f73b6334f admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:18.120936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbd474-b23f-47c0-8310-087f73b6334f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:18.121243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbd474-b23f-47c0-8310-087f73b6334f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:18.148795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbd474-b23f-47c0-8310-087f73b6334f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:18.162683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 422/844] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:58:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:18.169295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0fe94-8b86-4122-8642-d2ee24a7df17 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:18.178783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0fe94-8b86-4122-8642-d2ee24a7df17 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:18.182837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392f3d8-16c6-4023-a04a-da672a46f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:18.183410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392f3d8-16c6-4023-a04a-da672a46f339 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:18.183697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392f3d8-16c6-4023-a04a-da672a46f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:18.183976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392f3d8-16c6-4023-a04a-da672a46f339 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:18.184748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392f3d8-16c6-4023-a04a-da672a46f339 admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=dea5ec2125f0468baa1e15a429021e0c) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:18.185054 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392f3d8-16c6-4023-a04a-da672a46f339 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:18.210362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392f3d8-16c6-4023-a04a-da672a46f339 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:18.216679 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 423/845] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:58:18 2021] GET /identity/v3/role_assignments?user.id=dea5ec2125f0468baa1e15a429021e0c&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:58:20.230464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314832-3175-415e-967d-ca13b9772834 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:20.231101 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314832-3175-415e-967d-ca13b9772834 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:20.231101 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314832-3175-415e-967d-ca13b9772834 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:20.232801 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 423/846] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:20.239217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba94e-af89-468c-b125-232cba7fedde None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:20.239654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba94e-af89-468c-b125-232cba7fedde None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:20.239839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba94e-af89-468c-b125-232cba7fedde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:20.270730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-01aba94e-af89-468c-b125-232cba7fedde None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:20.272216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-01aba94e-af89-468c-b125-232cba7fedde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:20.280129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 424/847] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:20 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:20.306397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314832-3175-415e-967d-ca13b9772834 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:20.318718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314832-3175-415e-967d-ca13b9772834 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:20.322958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75479cdd-5c74-4e39-8772-58e0e83a7cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:20.323790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75479cdd-5c74-4e39-8772-58e0e83a7cfc admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:20.324084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75479cdd-5c74-4e39-8772-58e0e83a7cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:20.324366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75479cdd-5c74-4e39-8772-58e0e83a7cfc admin admin] PATH_INFO: `/v3/services/network` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:20.324991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75479cdd-5c74-4e39-8772-58e0e83a7cfc admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:20.356533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75479cdd-5c74-4e39-8772-58e0e83a7cfc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:20.368276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-75479cdd-5c74-4e39-8772-58e0e83a7cfc admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:58:20.369558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 424/848] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:20 2021] GET /identity/v3/services/network => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:20.375718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba94e-af89-468c-b125-232cba7fedde None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:20.386205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba94e-af89-468c-b125-232cba7fedde None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:20.390606 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f6900-23b7-481a-87ba-5833a2d2c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:20.391222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f6900-23b7-481a-87ba-5833a2d2c8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:20.391509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f6900-23b7-481a-87ba-5833a2d2c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:20.391793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f6900-23b7-481a-87ba-5833a2d2c8a6 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:20.392810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f6900-23b7-481a-87ba-5833a2d2c8a6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:20.393324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f6900-23b7-481a-87ba-5833a2d2c8a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:20.426008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f6900-23b7-481a-87ba-5833a2d2c8a6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:20.432548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 425/849] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:58:20 2021] GET /identity/v3/services?name=network => generated 124 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:20.438421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75479cdd-5c74-4e39-8772-58e0e83a7cfc admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:20.450645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75479cdd-5c74-4e39-8772-58e0e83a7cfc admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:20.456548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016de60-678b-42dc-af0a-9c50f4b73f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:20.457151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016de60-678b-42dc-af0a-9c50f4b73f81 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:20.457445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016de60-678b-42dc-af0a-9c50f4b73f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:20.457741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016de60-678b-42dc-af0a-9c50f4b73f81 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:20.458411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016de60-678b-42dc-af0a-9c50f4b73f81 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:20.458746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016de60-678b-42dc-af0a-9c50f4b73f81 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:20.489923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016de60-678b-42dc-af0a-9c50f4b73f81 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:20.496596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 425/850] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:58:20 2021] GET /identity/v3/services?type=network => generated 124 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:22.594688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e309a-574c-4e75-a8c2-9330f6e895c3 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:22.595213 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e309a-574c-4e75-a8c2-9330f6e895c3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:22.595299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e309a-574c-4e75-a8c2-9330f6e895c3 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:22.596933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 426/851] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:22.602076 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2542c-8da2-4f6d-8471-2508d77bb6c2 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:22.602483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2542c-8da2-4f6d-8471-2508d77bb6c2 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:22.602687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2542c-8da2-4f6d-8471-2508d77bb6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:22.625944 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3dd2542c-8da2-4f6d-8471-2508d77bb6c2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:22.627112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3dd2542c-8da2-4f6d-8471-2508d77bb6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:22.633913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 426/852] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:22 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:58:22.656134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e309a-574c-4e75-a8c2-9330f6e895c3 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:22.667765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e309a-574c-4e75-a8c2-9330f6e895c3 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:22.671632 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5d26a-cff8-46eb-9b5a-f6b375f8b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:22.672202 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5d26a-cff8-46eb-9b5a-f6b375f8b589 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:22.672486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5d26a-cff8-46eb-9b5a-f6b375f8b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:22.672765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5d26a-cff8-46eb-9b5a-f6b375f8b589 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:22.673438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5d26a-cff8-46eb-9b5a-f6b375f8b589 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:22.699513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5d26a-cff8-46eb-9b5a-f6b375f8b589 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:22.712611 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 427/853] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:58:22 2021] POST /identity/v3/services => generated 240 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:58:24.682980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68298cbe-a101-427e-868d-334da80ddf1f None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:24.683512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68298cbe-a101-427e-868d-334da80ddf1f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:24.683598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68298cbe-a101-427e-868d-334da80ddf1f None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:24.685217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 427/854] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:24.690381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dc0be-e4e5-4fcf-bb07-6d0ae411f4ea None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:24.690805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dc0be-e4e5-4fcf-bb07-6d0ae411f4ea None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:24.690977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dc0be-e4e5-4fcf-bb07-6d0ae411f4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:24.714156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a61dc0be-e4e5-4fcf-bb07-6d0ae411f4ea None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:24.715320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a61dc0be-e4e5-4fcf-bb07-6d0ae411f4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:24.733229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 428/855] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:24 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:24.755146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68298cbe-a101-427e-868d-334da80ddf1f None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:24.766715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68298cbe-a101-427e-868d-334da80ddf1f None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:24.770703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db5737-41b4-4987-b8df-8cb04df3b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:24.771421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db5737-41b4-4987-b8df-8cb04df3b24b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:24.771716 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db5737-41b4-4987-b8df-8cb04df3b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:24.772000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db5737-41b4-4987-b8df-8cb04df3b24b admin admin] PATH_INFO: `/v3/services/network` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:24.772623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db5737-41b4-4987-b8df-8cb04df3b24b admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:24.799214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db5737-41b4-4987-b8df-8cb04df3b24b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:24.809702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-61db5737-41b4-4987-b8df-8cb04df3b24b admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:58:24.810808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 428/856] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:24 2021] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:24.817445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dc0be-e4e5-4fcf-bb07-6d0ae411f4ea None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:24.826338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dc0be-e4e5-4fcf-bb07-6d0ae411f4ea None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:24.830401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51c106-bb05-4e34-8b86-5d3c9210c3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:24.831025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51c106-bb05-4e34-8b86-5d3c9210c3bd admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:24.831317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51c106-bb05-4e34-8b86-5d3c9210c3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:24.831602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51c106-bb05-4e34-8b86-5d3c9210c3bd admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:24.832275 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51c106-bb05-4e34-8b86-5d3c9210c3bd admin admin] RBAC: Adding query filter params (name=network) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:24.832578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51c106-bb05-4e34-8b86-5d3c9210c3bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:24.858711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51c106-bb05-4e34-8b86-5d3c9210c3bd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:24.864096 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 429/857] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:58:24 2021] GET /identity/v3/services?name=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:24.870073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db5737-41b4-4987-b8df-8cb04df3b24b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:24.879372 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db5737-41b4-4987-b8df-8cb04df3b24b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:24.883560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca397f58-8e98-4b5a-ae08-f686ba01ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:24.884147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca397f58-8e98-4b5a-ae08-f686ba01ec14 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:24.884437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca397f58-8e98-4b5a-ae08-f686ba01ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:24.884768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca397f58-8e98-4b5a-ae08-f686ba01ec14 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:24.885509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca397f58-8e98-4b5a-ae08-f686ba01ec14 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:24.885808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca397f58-8e98-4b5a-ae08-f686ba01ec14 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:24.911912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca397f58-8e98-4b5a-ae08-f686ba01ec14 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:24.917468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 429/858] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:58:24 2021] GET /identity/v3/services?type=network => generated 350 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:24.923259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51c106-bb05-4e34-8b86-5d3c9210c3bd admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:24.932734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51c106-bb05-4e34-8b86-5d3c9210c3bd admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:24.936976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688c11-f479-42d4-b02e-4eda4ee3aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:24.937492 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688c11-f479-42d4-b02e-4eda4ee3aabe admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:24.937781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688c11-f479-42d4-b02e-4eda4ee3aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:24.938061 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688c11-f479-42d4-b02e-4eda4ee3aabe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:24.938825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688c11-f479-42d4-b02e-4eda4ee3aabe admin admin] RBAC: Adding query filter params (interface=public, service_id=7ee5f12eb7a44ae3ad8dea6609d7d0b6, region_id=RegionOne) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:24.939130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688c11-f479-42d4-b02e-4eda4ee3aabe admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:24.964669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688c11-f479-42d4-b02e-4eda4ee3aabe admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:24.970122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 430/859] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Oct 27 13:58:24 2021] GET /identity/v3/endpoints?service_id=7ee5f12eb7a44ae3ad8dea6609d7d0b6&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:24.975552 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca397f58-8e98-4b5a-ae08-f686ba01ec14 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:24.985876 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca397f58-8e98-4b5a-ae08-f686ba01ec14 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:24.989953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204dc6f-d10f-471f-9a97-228f1825430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:24.990537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204dc6f-d10f-471f-9a97-228f1825430c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:24.990884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204dc6f-d10f-471f-9a97-228f1825430c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:24.991141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204dc6f-d10f-471f-9a97-228f1825430c admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:24.991779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204dc6f-d10f-471f-9a97-228f1825430c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:25.017237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204dc6f-d10f-471f-9a97-228f1825430c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:25.024068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 430/860] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 13:58:24 2021] GET /identity/v3/services => generated 1967 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:58:27.001019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19641f-ae7e-4b71-9fdf-d8a1adef6324 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:27.001538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19641f-ae7e-4b71-9fdf-d8a1adef6324 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:27.001652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19641f-ae7e-4b71-9fdf-d8a1adef6324 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:27.003301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 431/861] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:27.008420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f350f-a03a-4c07-a90e-e7631a2004ff None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:27.008794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f350f-a03a-4c07-a90e-e7631a2004ff None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:27.008994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f350f-a03a-4c07-a90e-e7631a2004ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:27.032039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-f51f350f-a03a-4c07-a90e-e7631a2004ff None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:27.033187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f51f350f-a03a-4c07-a90e-e7631a2004ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:27.040277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 431/862] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:27 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:58:27.062382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19641f-ae7e-4b71-9fdf-d8a1adef6324 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:27.074101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19641f-ae7e-4b71-9fdf-d8a1adef6324 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:27.078063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb083f7-877e-4aa3-a46f-d89598cef7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:27.078805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb083f7-877e-4aa3-a46f-d89598cef7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:27.079097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb083f7-877e-4aa3-a46f-d89598cef7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:27.079381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb083f7-877e-4aa3-a46f-d89598cef7b5 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:27.079996 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb083f7-877e-4aa3-a46f-d89598cef7b5 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:27.105992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb083f7-877e-4aa3-a46f-d89598cef7b5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:27.116591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-feb083f7-877e-4aa3-a46f-d89598cef7b5 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 13:58:27.117673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 432/863] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:27 2021] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:27.123766 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f350f-a03a-4c07-a90e-e7631a2004ff None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:27.132305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f350f-a03a-4c07-a90e-e7631a2004ff None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:27.136546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62578e6-930a-4496-96a0-588ffb16589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:27.137228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62578e6-930a-4496-96a0-588ffb16589e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:27.137533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62578e6-930a-4496-96a0-588ffb16589e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:27.137818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62578e6-930a-4496-96a0-588ffb16589e admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:27.138490 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62578e6-930a-4496-96a0-588ffb16589e admin admin] RBAC: Adding query filter params (name=network) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:27.138824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62578e6-930a-4496-96a0-588ffb16589e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:27.164357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62578e6-930a-4496-96a0-588ffb16589e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:27.170286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 432/864] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:58:27 2021] GET /identity/v3/services?name=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:27.175910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb083f7-877e-4aa3-a46f-d89598cef7b5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:27.185288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb083f7-877e-4aa3-a46f-d89598cef7b5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:27.189323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbfd10-db25-45d5-8f91-5e85083b2a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:27.189904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfd10-db25-45d5-8f91-5e85083b2a8a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:27.190190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfd10-db25-45d5-8f91-5e85083b2a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:27.190471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfd10-db25-45d5-8f91-5e85083b2a8a admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:27.191165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbfd10-db25-45d5-8f91-5e85083b2a8a admin admin] RBAC: Adding query filter params (type=network) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:27.191467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbfd10-db25-45d5-8f91-5e85083b2a8a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:27.217220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbfd10-db25-45d5-8f91-5e85083b2a8a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:27.221927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 433/865] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Oct 27 13:58:27 2021] GET /identity/v3/services?type=network => generated 350 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:27.227520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62578e6-930a-4496-96a0-588ffb16589e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:27.237984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62578e6-930a-4496-96a0-588ffb16589e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:27.242133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d533d0-a4e8-43cb-82f3-8bea1fe0ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:27.242752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d533d0-a4e8-43cb-82f3-8bea1fe0ea89 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:27.243047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d533d0-a4e8-43cb-82f3-8bea1fe0ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:27.243336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d533d0-a4e8-43cb-82f3-8bea1fe0ea89 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:27.244031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d533d0-a4e8-43cb-82f3-8bea1fe0ea89 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:27.269761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d533d0-a4e8-43cb-82f3-8bea1fe0ea89 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:27.288063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 433/866] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 13:58:27 2021] POST /identity/v3/endpoints => generated 327 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:58:29.301933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad04cb-8af4-4b94-bf09-f12578e5ee51 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:29.302435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad04cb-8af4-4b94-bf09-f12578e5ee51 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:29.302435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad04cb-8af4-4b94-bf09-f12578e5ee51 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:29.304132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 434/867] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:29.311090 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae454-9632-4fbb-9cee-c161cc379da8 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:29.311507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae454-9632-4fbb-9cee-c161cc379da8 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:29.311673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae454-9632-4fbb-9cee-c161cc379da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:29.334190 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-5b5ae454-9632-4fbb-9cee-c161cc379da8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:29.335359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5b5ae454-9632-4fbb-9cee-c161cc379da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:29.354305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 434/868] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:58:29.377053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad04cb-8af4-4b94-bf09-f12578e5ee51 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:29.389513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad04cb-8af4-4b94-bf09-f12578e5ee51 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:29.393411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:29.394001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:29.394294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:29.394583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:29.395314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:29.420579 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:29.426495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.sql.core [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 13:58:29.426495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 13:58:29.426495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [parameters: {'id': 'e0af0d58cc984f70ac02a585796a69d8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 13:58:29.426495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66092) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Oct 27 13:58:29.432981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 13:58:29.434151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 435/869] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 13:58:29 2021] POST /identity/v3/roles => generated 144 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:29.440207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ae454-9632-4fbb-9cee-c161cc379da8 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:29.449439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ae454-9632-4fbb-9cee-c161cc379da8 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:29.453494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfcfb0-94e2-4405-8513-99fb683c5699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:29.454221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfcfb0-94e2-4405-8513-99fb683c5699 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:29.454510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfcfb0-94e2-4405-8513-99fb683c5699 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:29.454825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfcfb0-94e2-4405-8513-99fb683c5699 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:29.465865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfcfb0-94e2-4405-8513-99fb683c5699 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:29.472486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-48bfcfb0-94e2-4405-8513-99fb683c5699 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 13:58:29.473561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 435/870] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Oct 27 13:58:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:29.479839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:29.489332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72935c9-9070-4fcc-9ec7-365095955b4e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:29.493399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48169bc-cf85-428c-9639-4ad34df33ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:29.494051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48169bc-cf85-428c-9639-4ad34df33ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:29.494444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48169bc-cf85-428c-9639-4ad34df33ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:29.494774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48169bc-cf85-428c-9639-4ad34df33ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:29.495490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48169bc-cf85-428c-9639-4ad34df33ef3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:29.496046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48169bc-cf85-428c-9639-4ad34df33ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:29.521295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48169bc-cf85-428c-9639-4ad34df33ef3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:29.530495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 436/871] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:31.486682 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c5701-2a37-45b6-b71f-03abdd9e03dd None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:31.487217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c5701-2a37-45b6-b71f-03abdd9e03dd None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:31.487328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c5701-2a37-45b6-b71f-03abdd9e03dd None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:31.489026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 436/872] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:31.494708 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9fbf-5eb1-489b-9e27-9d0d3e15115d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:31.495135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9fbf-5eb1-489b-9e27-9d0d3e15115d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:31.495271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b9fbf-5eb1-489b-9e27-9d0d3e15115d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:31.518063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-113b9fbf-5eb1-489b-9e27-9d0d3e15115d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:31.519229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-113b9fbf-5eb1-489b-9e27-9d0d3e15115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:31.527420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 437/873] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:31.550861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c5701-2a37-45b6-b71f-03abdd9e03dd None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:31.563455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c5701-2a37-45b6-b71f-03abdd9e03dd None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:31.567369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fad488-130b-4095-bffa-27a4d61ce767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:31.568090 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fad488-130b-4095-bffa-27a4d61ce767 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:31.568381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fad488-130b-4095-bffa-27a4d61ce767 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:31.568667 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fad488-130b-4095-bffa-27a4d61ce767 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:31.579959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fad488-130b-4095-bffa-27a4d61ce767 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:31.606320 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fad488-130b-4095-bffa-27a4d61ce767 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:31.624274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-33fad488-130b-4095-bffa-27a4d61ce767 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:31.625379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 437/874] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:31.631472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b9fbf-5eb1-489b-9e27-9d0d3e15115d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:31.640228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b9fbf-5eb1-489b-9e27-9d0d3e15115d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:31.644385 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b719aa-4924-4976-94e4-db2d30dcc239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:31.644969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b719aa-4924-4976-94e4-db2d30dcc239 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:31.645262 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b719aa-4924-4976-94e4-db2d30dcc239 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:31.645547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b719aa-4924-4976-94e4-db2d30dcc239 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:31.646228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b719aa-4924-4976-94e4-db2d30dcc239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:31.646533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b719aa-4924-4976-94e4-db2d30dcc239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:31.672835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b719aa-4924-4976-94e4-db2d30dcc239 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:31.685731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 438/875] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:31.691506 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fad488-130b-4095-bffa-27a4d61ce767 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:31.701770 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fad488-130b-4095-bffa-27a4d61ce767 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:31.705956 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615d37a-b91c-4d7f-a9b4-54c380ad4693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:31.706587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615d37a-b91c-4d7f-a9b4-54c380ad4693 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:31.706909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615d37a-b91c-4d7f-a9b4-54c380ad4693 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:31.707196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615d37a-b91c-4d7f-a9b4-54c380ad4693 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:31.707921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615d37a-b91c-4d7f-a9b4-54c380ad4693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:31.735579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615d37a-b91c-4d7f-a9b4-54c380ad4693 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:31.755436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 438/876] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:58:31 2021] POST /identity/v3/users => generated 247 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:58:33.767981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce113-59bf-4537-948b-6ae9aeec8cbb None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:33.768554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce113-59bf-4537-948b-6ae9aeec8cbb None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:33.768554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce113-59bf-4537-948b-6ae9aeec8cbb None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:33.770276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 439/877] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:33.775635 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7e3da-a8e4-4ed4-a9e8-5866e3411b33 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:33.776076 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7e3da-a8e4-4ed4-a9e8-5866e3411b33 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:33.776208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7e3da-a8e4-4ed4-a9e8-5866e3411b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:33.799900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-dff7e3da-a8e4-4ed4-a9e8-5866e3411b33 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:33.801066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-dff7e3da-a8e4-4ed4-a9e8-5866e3411b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:33.808919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 439/878] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:33.834753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce113-59bf-4537-948b-6ae9aeec8cbb None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:33.847547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce113-59bf-4537-948b-6ae9aeec8cbb None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:33.851594 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b752a38-04ac-4df8-9985-f379536cc9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:33.852312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b752a38-04ac-4df8-9985-f379536cc9de admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:33.852604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b752a38-04ac-4df8-9985-f379536cc9de admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:33.852889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b752a38-04ac-4df8-9985-f379536cc9de admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:33.865482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b752a38-04ac-4df8-9985-f379536cc9de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:33.871915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-9b752a38-04ac-4df8-9985-f379536cc9de admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:58:33.873052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 440/879] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:58:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:33.879131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7e3da-a8e4-4ed4-a9e8-5866e3411b33 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:33.887854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7e3da-a8e4-4ed4-a9e8-5866e3411b33 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:33.892114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60677ac8-d795-4762-8003-ef6f4a28667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:33.892744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60677ac8-d795-4762-8003-ef6f4a28667f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:33.893029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60677ac8-d795-4762-8003-ef6f4a28667f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:33.893349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60677ac8-d795-4762-8003-ef6f4a28667f admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:33.894187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60677ac8-d795-4762-8003-ef6f4a28667f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:33.894487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60677ac8-d795-4762-8003-ef6f4a28667f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:33.921325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60677ac8-d795-4762-8003-ef6f4a28667f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:33.930541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 440/880] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:58:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:33.936951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b752a38-04ac-4df8-9985-f379536cc9de admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:33.948536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b752a38-04ac-4df8-9985-f379536cc9de admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:33.952760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf981c-feb1-4a97-a2eb-49fafced610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:33.953489 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf981c-feb1-4a97-a2eb-49fafced610f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:33.953782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf981c-feb1-4a97-a2eb-49fafced610f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:33.954069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf981c-feb1-4a97-a2eb-49fafced610f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:33.967256 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf981c-feb1-4a97-a2eb-49fafced610f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:33.995328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf981c-feb1-4a97-a2eb-49fafced610f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.015091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-fddf981c-feb1-4a97-a2eb-49fafced610f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:34.016235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 441/881] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:34.022010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60677ac8-d795-4762-8003-ef6f4a28667f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:34.032645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60677ac8-d795-4762-8003-ef6f4a28667f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:34.036959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b987639-575a-4bad-b29b-94bb049d9ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:34.037544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b987639-575a-4bad-b29b-94bb049d9ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:34.037838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b987639-575a-4bad-b29b-94bb049d9ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:34.038120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b987639-575a-4bad-b29b-94bb049d9ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:34.038831 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b987639-575a-4bad-b29b-94bb049d9ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:34.039133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b987639-575a-4bad-b29b-94bb049d9ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:34.064769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b987639-575a-4bad-b29b-94bb049d9ee9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.079580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 441/882] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:34.085267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf981c-feb1-4a97-a2eb-49fafced610f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:34.095532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf981c-feb1-4a97-a2eb-49fafced610f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:34.099584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ba8f6-a273-4729-8429-4d847c3db332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:34.100292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ba8f6-a273-4729-8429-4d847c3db332 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:34.100581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ba8f6-a273-4729-8429-4d847c3db332 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:34.100869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ba8f6-a273-4729-8429-4d847c3db332 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:34.113855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ba8f6-a273-4729-8429-4d847c3db332 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:34.139801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ba8f6-a273-4729-8429-4d847c3db332 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.158433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-cd3ba8f6-a273-4729-8429-4d847c3db332 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:58:34.159518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 442/883] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:58:34 2021] GET /identity/v3/users/swift => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:34.165791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b987639-575a-4bad-b29b-94bb049d9ee9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:34.175016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b987639-575a-4bad-b29b-94bb049d9ee9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:34.179037 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8098a-8782-413a-9dcb-0d8692387d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:34.179622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8098a-8782-413a-9dcb-0d8692387d65 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:34.179907 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8098a-8782-413a-9dcb-0d8692387d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:34.180186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8098a-8782-413a-9dcb-0d8692387d65 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:34.180965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8098a-8782-413a-9dcb-0d8692387d65 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:34.181308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8098a-8782-413a-9dcb-0d8692387d65 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:34.206699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8098a-8782-413a-9dcb-0d8692387d65 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.236292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 442/884] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Oct 27 13:58:34 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:34.242107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ba8f6-a273-4729-8429-4d847c3db332 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:34.251530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ba8f6-a273-4729-8429-4d847c3db332 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:34.255555 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed85b4-ef44-48d5-b330-e29f9325a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:34.256123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed85b4-ef44-48d5-b330-e29f9325a46e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:34.256417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed85b4-ef44-48d5-b330-e29f9325a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:34.256700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed85b4-ef44-48d5-b330-e29f9325a46e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:34.267177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed85b4-ef44-48d5-b330-e29f9325a46e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:34.293509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed85b4-ef44-48d5-b330-e29f9325a46e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.306321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 443/885] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:58:34 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:58:34.312644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8098a-8782-413a-9dcb-0d8692387d65 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:34.325637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8098a-8782-413a-9dcb-0d8692387d65 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:34.329933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ccafd-8261-4f21-aaaa-af8c1ab38926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:34.330754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ccafd-8261-4f21-aaaa-af8c1ab38926 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:34.331052 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ccafd-8261-4f21-aaaa-af8c1ab38926 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:34.331341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ccafd-8261-4f21-aaaa-af8c1ab38926 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:34.344142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ccafd-8261-4f21-aaaa-af8c1ab38926 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:34.374340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ccafd-8261-4f21-aaaa-af8c1ab38926 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.392913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-8e1ccafd-8261-4f21-aaaa-af8c1ab38926 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:34.394031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 443/886] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:58:34.399847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed85b4-ef44-48d5-b330-e29f9325a46e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:34.408557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed85b4-ef44-48d5-b330-e29f9325a46e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:34.412716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627e49e-d0b3-4bf2-b6e4-e24b75c501b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:34.413292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e49e-d0b3-4bf2-b6e4-e24b75c501b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:34.413579 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e49e-d0b3-4bf2-b6e4-e24b75c501b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:34.413858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e49e-d0b3-4bf2-b6e4-e24b75c501b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:34.414531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e49e-d0b3-4bf2-b6e4-e24b75c501b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:34.414852 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e49e-d0b3-4bf2-b6e4-e24b75c501b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:34.440479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e49e-d0b3-4bf2-b6e4-e24b75c501b8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.453787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 444/887] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:34.459482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ccafd-8261-4f21-aaaa-af8c1ab38926 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:34.468886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ccafd-8261-4f21-aaaa-af8c1ab38926 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:34.472928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6fcf8-282a-4038-a461-575789106f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:34.473644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6fcf8-282a-4038-a461-575789106f84 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:34.473937 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6fcf8-282a-4038-a461-575789106f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:34.474224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6fcf8-282a-4038-a461-575789106f84 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:34.483352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6fcf8-282a-4038-a461-575789106f84 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:34.510098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6fcf8-282a-4038-a461-575789106f84 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.523955 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-2ed6fcf8-282a-4038-a461-575789106f84 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:34.525066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 444/888] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:34.530942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627e49e-d0b3-4bf2-b6e4-e24b75c501b8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:34.540364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627e49e-d0b3-4bf2-b6e4-e24b75c501b8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:34.544768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a0288-275b-4ddb-a7f8-ff26ef03950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:34.545301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0288-275b-4ddb-a7f8-ff26ef03950f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:34.545590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0288-275b-4ddb-a7f8-ff26ef03950f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:34.545876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0288-275b-4ddb-a7f8-ff26ef03950f admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:34.546634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a0288-275b-4ddb-a7f8-ff26ef03950f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:34.546962 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a0288-275b-4ddb-a7f8-ff26ef03950f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:34.573345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a0288-275b-4ddb-a7f8-ff26ef03950f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.586975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 445/889] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:58:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:34.593253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6fcf8-282a-4038-a461-575789106f84 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:34.603655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6fcf8-282a-4038-a461-575789106f84 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:34.607487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acf0df-53e8-4af2-a016-1c631b37e718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:34.608075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf0df-53e8-4af2-a016-1c631b37e718 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:34.608367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf0df-53e8-4af2-a016-1c631b37e718 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:34.608654 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf0df-53e8-4af2-a016-1c631b37e718 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:34.609439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf0df-53e8-4af2-a016-1c631b37e718 admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=e56f87a3cc4c4503a156700b66525530) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:34.610012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf0df-53e8-4af2-a016-1c631b37e718 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:34.636717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf0df-53e8-4af2-a016-1c631b37e718 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:34.642399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 445/890] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:58:34 2021] GET /identity/v3/role_assignments?user.id=e56f87a3cc4c4503a156700b66525530&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:36.585249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642400-b4f6-4726-9afe-9aaa1a961f85 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:36.585773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642400-b4f6-4726-9afe-9aaa1a961f85 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:36.585861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642400-b4f6-4726-9afe-9aaa1a961f85 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:36.588111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 446/891] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:36.593438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98136c83-2d96-453b-84b8-96a1b0c1b077 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:36.593814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98136c83-2d96-453b-84b8-96a1b0c1b077 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:36.594003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98136c83-2d96-453b-84b8-96a1b0c1b077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:36.616482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-98136c83-2d96-453b-84b8-96a1b0c1b077 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:36.617612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-98136c83-2d96-453b-84b8-96a1b0c1b077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:36.625240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 446/892] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:36.646954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642400-b4f6-4726-9afe-9aaa1a961f85 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:36.658510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642400-b4f6-4726-9afe-9aaa1a961f85 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:36.662395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da37b0-1a94-49b0-8ad6-3b4675b352e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:36.663128 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da37b0-1a94-49b0-8ad6-3b4675b352e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:36.663421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da37b0-1a94-49b0-8ad6-3b4675b352e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:36.663704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da37b0-1a94-49b0-8ad6-3b4675b352e8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:36.674912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da37b0-1a94-49b0-8ad6-3b4675b352e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:36.681765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-c1da37b0-1a94-49b0-8ad6-3b4675b352e8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:58:36.682918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 447/893] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:58:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:36.689388 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98136c83-2d96-453b-84b8-96a1b0c1b077 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:36.698669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98136c83-2d96-453b-84b8-96a1b0c1b077 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:36.702719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f6c3d-ce7e-4b27-9d59-469d1dffefce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:36.703309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f6c3d-ce7e-4b27-9d59-469d1dffefce admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:36.703596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f6c3d-ce7e-4b27-9d59-469d1dffefce admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:36.703880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f6c3d-ce7e-4b27-9d59-469d1dffefce admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:36.704584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f6c3d-ce7e-4b27-9d59-469d1dffefce admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:36.704882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f6c3d-ce7e-4b27-9d59-469d1dffefce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:36.729753 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f6c3d-ce7e-4b27-9d59-469d1dffefce admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:36.738476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 447/894] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:58:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:36.744736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da37b0-1a94-49b0-8ad6-3b4675b352e8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:36.754808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da37b0-1a94-49b0-8ad6-3b4675b352e8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:36.758963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36f56-2bd8-4075-b5e9-54ccff1a17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:36.760247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36f56-2bd8-4075-b5e9-54ccff1a17d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:36.760540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36f56-2bd8-4075-b5e9-54ccff1a17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:36.760826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36f56-2bd8-4075-b5e9-54ccff1a17d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:36.772792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36f56-2bd8-4075-b5e9-54ccff1a17d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:36.798212 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36f56-2bd8-4075-b5e9-54ccff1a17d3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:36.819487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-e3a36f56-2bd8-4075-b5e9-54ccff1a17d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:36.820626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 448/895] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:36.827175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f6c3d-ce7e-4b27-9d59-469d1dffefce admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:36.836570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f6c3d-ce7e-4b27-9d59-469d1dffefce admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:36.841201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55549ffa-9195-4417-9c0b-3658ef8c21ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:36.841798 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549ffa-9195-4417-9c0b-3658ef8c21ec admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:36.842092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549ffa-9195-4417-9c0b-3658ef8c21ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:36.842378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549ffa-9195-4417-9c0b-3658ef8c21ec admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:36.843126 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55549ffa-9195-4417-9c0b-3658ef8c21ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:36.843427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55549ffa-9195-4417-9c0b-3658ef8c21ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:36.870942 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55549ffa-9195-4417-9c0b-3658ef8c21ec admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:36.885158 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 448/896] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:36.891267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36f56-2bd8-4075-b5e9-54ccff1a17d3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:36.900979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36f56-2bd8-4075-b5e9-54ccff1a17d3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:36.905143 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081fb9c-0b3b-4207-9e85-0b34bcc6d285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:36.905861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081fb9c-0b3b-4207-9e85-0b34bcc6d285 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:36.906152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081fb9c-0b3b-4207-9e85-0b34bcc6d285 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:36.906437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081fb9c-0b3b-4207-9e85-0b34bcc6d285 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:36.919369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081fb9c-0b3b-4207-9e85-0b34bcc6d285 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:36.945400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081fb9c-0b3b-4207-9e85-0b34bcc6d285 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:36.964224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-e081fb9c-0b3b-4207-9e85-0b34bcc6d285 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:58:36.965332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 449/897] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:58:36 2021] GET /identity/v3/users/swift => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:36.971242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55549ffa-9195-4417-9c0b-3658ef8c21ec admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:36.981462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55549ffa-9195-4417-9c0b-3658ef8c21ec admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:36.986034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb716-c49e-4ad9-a398-c92ba03398fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:36.986650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb716-c49e-4ad9-a398-c92ba03398fd admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:36.986945 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb716-c49e-4ad9-a398-c92ba03398fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:36.987228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb716-c49e-4ad9-a398-c92ba03398fd admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:36.988012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fb716-c49e-4ad9-a398-c92ba03398fd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:36.988315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fb716-c49e-4ad9-a398-c92ba03398fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:37.014125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fb716-c49e-4ad9-a398-c92ba03398fd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:37.043402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 449/898] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Oct 27 13:58:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:37.049238 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081fb9c-0b3b-4207-9e85-0b34bcc6d285 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:37.059309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081fb9c-0b3b-4207-9e85-0b34bcc6d285 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:37.063294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfadadc-5cb1-4c5b-9d2a-1b7f280b2a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:37.064008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfadadc-5cb1-4c5b-9d2a-1b7f280b2a6e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:37.064301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfadadc-5cb1-4c5b-9d2a-1b7f280b2a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:37.064584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfadadc-5cb1-4c5b-9d2a-1b7f280b2a6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:37.077145 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfadadc-5cb1-4c5b-9d2a-1b7f280b2a6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:37.102306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfadadc-5cb1-4c5b-9d2a-1b7f280b2a6e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:37.120916 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-2cfadadc-5cb1-4c5b-9d2a-1b7f280b2a6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:37.122025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 450/899] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:37.127838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb716-c49e-4ad9-a398-c92ba03398fd admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:37.137429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb716-c49e-4ad9-a398-c92ba03398fd admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:37.141444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608087d-0a4b-4f01-b2ce-11df6894f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:37.142033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608087d-0a4b-4f01-b2ce-11df6894f505 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:37.142324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608087d-0a4b-4f01-b2ce-11df6894f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:37.142607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608087d-0a4b-4f01-b2ce-11df6894f505 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:37.143320 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608087d-0a4b-4f01-b2ce-11df6894f505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:37.143620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608087d-0a4b-4f01-b2ce-11df6894f505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:37.169676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608087d-0a4b-4f01-b2ce-11df6894f505 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:37.183849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 450/900] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:37.189565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfadadc-5cb1-4c5b-9d2a-1b7f280b2a6e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:37.199033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfadadc-5cb1-4c5b-9d2a-1b7f280b2a6e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:37.203034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2729a86-230f-42f2-9abd-d9bad91a1ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:37.203744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2729a86-230f-42f2-9abd-d9bad91a1ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:37.204042 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2729a86-230f-42f2-9abd-d9bad91a1ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:37.204326 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2729a86-230f-42f2-9abd-d9bad91a1ca5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:37.213353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2729a86-230f-42f2-9abd-d9bad91a1ca5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:37.239519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2729a86-230f-42f2-9abd-d9bad91a1ca5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:37.253919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-a2729a86-230f-42f2-9abd-d9bad91a1ca5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:37.255035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 451/901] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:37.260980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608087d-0a4b-4f01-b2ce-11df6894f505 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:37.270304 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608087d-0a4b-4f01-b2ce-11df6894f505 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:37.274397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b692696-1ef9-4fe9-bc3d-8fefdd0b1dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:37.275069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b692696-1ef9-4fe9-bc3d-8fefdd0b1dea admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:37.275428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b692696-1ef9-4fe9-bc3d-8fefdd0b1dea admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:37.275719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b692696-1ef9-4fe9-bc3d-8fefdd0b1dea admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:37.276473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b692696-1ef9-4fe9-bc3d-8fefdd0b1dea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:37.276778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b692696-1ef9-4fe9-bc3d-8fefdd0b1dea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:37.302721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b692696-1ef9-4fe9-bc3d-8fefdd0b1dea admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:37.316865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 451/902] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:58:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:37.323409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2729a86-230f-42f2-9abd-d9bad91a1ca5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:37.333581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2729a86-230f-42f2-9abd-d9bad91a1ca5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:37.337946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba954bb-5466-49f7-8c3a-19f88cad6abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:37.338921 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba954bb-5466-49f7-8c3a-19f88cad6abd admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:37.339216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba954bb-5466-49f7-8c3a-19f88cad6abd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:37.339505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba954bb-5466-49f7-8c3a-19f88cad6abd admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/e56f87a3cc4c4503a156700b66525530/roles/18aaf45888374560a4c11e1912d42c97` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:37.360679 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba954bb-5466-49f7-8c3a-19f88cad6abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=e56f87a3cc4c4503a156700b66525530, role_id=18aaf45888374560a4c11e1912d42c97)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:37.387349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba954bb-5466-49f7-8c3a-19f88cad6abd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:37.401640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 452/903] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:58:37 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/e56f87a3cc4c4503a156700b66525530/roles/18aaf45888374560a4c11e1912d42c97 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:58:39.395539 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98c711-2255-42d9-b46c-0d359feb3e58 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:39.396119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98c711-2255-42d9-b46c-0d359feb3e58 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:39.396119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98c711-2255-42d9-b46c-0d359feb3e58 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:39.397768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 452/904] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:39.403425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044977-503a-4a5b-a23e-b8f85ddf0b2b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:39.403878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044977-503a-4a5b-a23e-b8f85ddf0b2b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:39.403976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044977-503a-4a5b-a23e-b8f85ddf0b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:39.426600 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-31044977-503a-4a5b-a23e-b8f85ddf0b2b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:39.427760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-31044977-503a-4a5b-a23e-b8f85ddf0b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:39.492157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 453/905] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:39.514999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98c711-2255-42d9-b46c-0d359feb3e58 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:39.527210 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98c711-2255-42d9-b46c-0d359feb3e58 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:39.531268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042885-c79c-484b-a6f9-e8ff3ece0003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:39.531986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042885-c79c-484b-a6f9-e8ff3ece0003 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:39.532280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042885-c79c-484b-a6f9-e8ff3ece0003 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:39.532566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042885-c79c-484b-a6f9-e8ff3ece0003 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:39.543597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042885-c79c-484b-a6f9-e8ff3ece0003 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:39.549850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-40042885-c79c-484b-a6f9-e8ff3ece0003 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 13:58:39.550966 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 453/906] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 13:58:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:39.557154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31044977-503a-4a5b-a23e-b8f85ddf0b2b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:39.566235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31044977-503a-4a5b-a23e-b8f85ddf0b2b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:39.570488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba75f95-d833-42f3-ae8c-2f5ae9c0da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:39.571170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba75f95-d833-42f3-ae8c-2f5ae9c0da2f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:39.571506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba75f95-d833-42f3-ae8c-2f5ae9c0da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:39.572345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba75f95-d833-42f3-ae8c-2f5ae9c0da2f admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:39.573150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba75f95-d833-42f3-ae8c-2f5ae9c0da2f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:39.573453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba75f95-d833-42f3-ae8c-2f5ae9c0da2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:39.599431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba75f95-d833-42f3-ae8c-2f5ae9c0da2f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:39.608304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 454/907] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 13:58:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:39.614295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042885-c79c-484b-a6f9-e8ff3ece0003 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:39.624748 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042885-c79c-484b-a6f9-e8ff3ece0003 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:39.628891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79237-eb5e-4b5f-9218-fbd03e72afec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:39.629604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79237-eb5e-4b5f-9218-fbd03e72afec admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:39.629898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79237-eb5e-4b5f-9218-fbd03e72afec admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:39.630189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79237-eb5e-4b5f-9218-fbd03e72afec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:39.642008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a79237-eb5e-4b5f-9218-fbd03e72afec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:39.667370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a79237-eb5e-4b5f-9218-fbd03e72afec admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:39.686592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-06a79237-eb5e-4b5f-9218-fbd03e72afec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:39.687717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 454/908] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:39.693651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba75f95-d833-42f3-ae8c-2f5ae9c0da2f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:39.703809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba75f95-d833-42f3-ae8c-2f5ae9c0da2f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:39.707922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d775e-c462-4a91-a824-f97398128f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:39.708510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d775e-c462-4a91-a824-f97398128f19 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:39.708793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d775e-c462-4a91-a824-f97398128f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:39.709072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d775e-c462-4a91-a824-f97398128f19 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:39.709753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d775e-c462-4a91-a824-f97398128f19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:39.710051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d775e-c462-4a91-a824-f97398128f19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:39.735591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d775e-c462-4a91-a824-f97398128f19 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:39.749649 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 455/909] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:39.755459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79237-eb5e-4b5f-9218-fbd03e72afec admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:39.765543 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79237-eb5e-4b5f-9218-fbd03e72afec admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:39.769706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f66d48-fd65-4ddd-a4a4-751dcc5948aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:39.770420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f66d48-fd65-4ddd-a4a4-751dcc5948aa admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:39.770744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f66d48-fd65-4ddd-a4a4-751dcc5948aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:39.771033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f66d48-fd65-4ddd-a4a4-751dcc5948aa admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:39.863114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f66d48-fd65-4ddd-a4a4-751dcc5948aa admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:39.889412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f66d48-fd65-4ddd-a4a4-751dcc5948aa admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:39.910214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-f3f66d48-fd65-4ddd-a4a4-751dcc5948aa admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:58:39.911390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 455/910] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:58:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:39.918119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d775e-c462-4a91-a824-f97398128f19 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:39.927508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d775e-c462-4a91-a824-f97398128f19 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:39.932083 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dec11-7c11-4ebf-ba56-042bd134fd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:39.932669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dec11-7c11-4ebf-ba56-042bd134fd58 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:39.932959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dec11-7c11-4ebf-ba56-042bd134fd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:39.933244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dec11-7c11-4ebf-ba56-042bd134fd58 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:39.934099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dec11-7c11-4ebf-ba56-042bd134fd58 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:39.934342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dec11-7c11-4ebf-ba56-042bd134fd58 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:39.960711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dec11-7c11-4ebf-ba56-042bd134fd58 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:39.991751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 456/911] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Oct 27 13:58:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:58:39.998183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f66d48-fd65-4ddd-a4a4-751dcc5948aa admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:40.007669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f66d48-fd65-4ddd-a4a4-751dcc5948aa admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:40.012004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc3a7-7f35-4f25-a6d9-d8b6bba5794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:40.012584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc3a7-7f35-4f25-a6d9-d8b6bba5794e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:40.012876 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc3a7-7f35-4f25-a6d9-d8b6bba5794e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:40.013211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc3a7-7f35-4f25-a6d9-d8b6bba5794e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:40.021338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc3a7-7f35-4f25-a6d9-d8b6bba5794e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:40.047083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc3a7-7f35-4f25-a6d9-d8b6bba5794e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:40.055877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 456/912] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:58:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:58:40.062475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dec11-7c11-4ebf-ba56-042bd134fd58 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:40.071989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dec11-7c11-4ebf-ba56-042bd134fd58 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:40.076018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3efb1-4b33-47b2-a860-5bacde300515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:40.076743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3efb1-4b33-47b2-a860-5bacde300515 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:40.077035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3efb1-4b33-47b2-a860-5bacde300515 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:40.077324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3efb1-4b33-47b2-a860-5bacde300515 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:40.089351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3efb1-4b33-47b2-a860-5bacde300515 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:40.115629 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3efb1-4b33-47b2-a860-5bacde300515 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:40.133502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-89a3efb1-4b33-47b2-a860-5bacde300515 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:40.134634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 457/913] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:40.140373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc3a7-7f35-4f25-a6d9-d8b6bba5794e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:40.148957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc3a7-7f35-4f25-a6d9-d8b6bba5794e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:40.153094 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00948-7b02-4bbc-9e04-190507301ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:40.153678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00948-7b02-4bbc-9e04-190507301ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:40.153967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00948-7b02-4bbc-9e04-190507301ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:40.154250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00948-7b02-4bbc-9e04-190507301ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:40.154968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f00948-7b02-4bbc-9e04-190507301ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:40.155351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f00948-7b02-4bbc-9e04-190507301ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:40.180629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f00948-7b02-4bbc-9e04-190507301ac2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:40.194211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 457/914] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:40.199967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3efb1-4b33-47b2-a860-5bacde300515 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:40.209249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3efb1-4b33-47b2-a860-5bacde300515 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:40.213320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26dd5f-3af4-4228-9ea9-3912327adc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:40.214026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26dd5f-3af4-4228-9ea9-3912327adc0b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:40.214310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26dd5f-3af4-4228-9ea9-3912327adc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:40.214585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26dd5f-3af4-4228-9ea9-3912327adc0b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:40.225683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26dd5f-3af4-4228-9ea9-3912327adc0b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:40.252117 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26dd5f-3af4-4228-9ea9-3912327adc0b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:40.266068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-6b26dd5f-3af4-4228-9ea9-3912327adc0b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:40.267199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 458/915] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:40.273103 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00948-7b02-4bbc-9e04-190507301ac2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:40.282493 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00948-7b02-4bbc-9e04-190507301ac2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:40.286679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa2d0a-0514-4400-8cc4-ea4883c60eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:40.287276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2d0a-0514-4400-8cc4-ea4883c60eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:40.287564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2d0a-0514-4400-8cc4-ea4883c60eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:40.287850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa2d0a-0514-4400-8cc4-ea4883c60eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:40.288596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa2d0a-0514-4400-8cc4-ea4883c60eb3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:40.288908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa2d0a-0514-4400-8cc4-ea4883c60eb3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:40.316125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa2d0a-0514-4400-8cc4-ea4883c60eb3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:40.329515 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 458/916] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:58:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:40.335669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26dd5f-3af4-4228-9ea9-3912327adc0b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:40.345427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26dd5f-3af4-4228-9ea9-3912327adc0b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:40.349522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf6ddd-94f1-49ed-8fbb-c1135e93c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:40.350109 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf6ddd-94f1-49ed-8fbb-c1135e93c87e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:40.350395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf6ddd-94f1-49ed-8fbb-c1135e93c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:40.350718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf6ddd-94f1-49ed-8fbb-c1135e93c87e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:40.351498 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf6ddd-94f1-49ed-8fbb-c1135e93c87e admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=e56f87a3cc4c4503a156700b66525530) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:40.351804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf6ddd-94f1-49ed-8fbb-c1135e93c87e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:40.378928 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf6ddd-94f1-49ed-8fbb-c1135e93c87e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:40.385370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 459/917] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:58:40 2021] GET /identity/v3/role_assignments?user.id=e56f87a3cc4c4503a156700b66525530&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:42.397331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cf490-573b-45e5-b4d6-7344062e3aa7 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:42.397904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cf490-573b-45e5-b4d6-7344062e3aa7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:42.397904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cf490-573b-45e5-b4d6-7344062e3aa7 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:42.399652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 459/918] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:42.405326 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebfc51-ecca-4193-85b4-76b67f13c2fe None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:42.405793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebfc51-ecca-4193-85b4-76b67f13c2fe None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:42.405926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebfc51-ecca-4193-85b4-76b67f13c2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:42.507378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-48ebfc51-ecca-4193-85b4-76b67f13c2fe None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:42.508517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-48ebfc51-ecca-4193-85b4-76b67f13c2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:42.516105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 460/919] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:42.538410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cf490-573b-45e5-b4d6-7344062e3aa7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:42.551198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cf490-573b-45e5-b4d6-7344062e3aa7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:42.555481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b92a84-071d-4401-861d-a3fe3293a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:42.557406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92a84-071d-4401-861d-a3fe3293a47c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:42.557781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92a84-071d-4401-861d-a3fe3293a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:42.558079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92a84-071d-4401-861d-a3fe3293a47c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:42.569758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b92a84-071d-4401-861d-a3fe3293a47c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:42.577040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-75b92a84-071d-4401-861d-a3fe3293a47c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:58:42.578313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 460/920] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:58:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:42.584567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebfc51-ecca-4193-85b4-76b67f13c2fe None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:42.593301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebfc51-ecca-4193-85b4-76b67f13c2fe None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:42.597341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64b0bc-2848-4837-b696-d36efbd78d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:42.597930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64b0bc-2848-4837-b696-d36efbd78d76 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:42.598220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64b0bc-2848-4837-b696-d36efbd78d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:42.598505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64b0bc-2848-4837-b696-d36efbd78d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:42.599253 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64b0bc-2848-4837-b696-d36efbd78d76 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:42.599553 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64b0bc-2848-4837-b696-d36efbd78d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:42.625843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64b0bc-2848-4837-b696-d36efbd78d76 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:42.634656 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 461/921] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:58:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:42.640608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b92a84-071d-4401-861d-a3fe3293a47c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:42.652274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b92a84-071d-4401-861d-a3fe3293a47c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:42.656819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f3bde-06a9-4b5e-86b0-c125e8d12407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:42.657623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3bde-06a9-4b5e-86b0-c125e8d12407 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:42.657919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3bde-06a9-4b5e-86b0-c125e8d12407 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:42.658205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3bde-06a9-4b5e-86b0-c125e8d12407 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:42.671011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f3bde-06a9-4b5e-86b0-c125e8d12407 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:42.699036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f3bde-06a9-4b5e-86b0-c125e8d12407 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:42.719368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-f74f3bde-06a9-4b5e-86b0-c125e8d12407 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:42.720581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 461/922] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:42.726344 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64b0bc-2848-4837-b696-d36efbd78d76 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:42.736917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64b0bc-2848-4837-b696-d36efbd78d76 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:42.740995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097eb539-35ae-4ff9-8a77-4f4c8696b542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:42.741575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097eb539-35ae-4ff9-8a77-4f4c8696b542 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:42.741864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097eb539-35ae-4ff9-8a77-4f4c8696b542 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:42.742147 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097eb539-35ae-4ff9-8a77-4f4c8696b542 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:42.742863 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097eb539-35ae-4ff9-8a77-4f4c8696b542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:42.743163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097eb539-35ae-4ff9-8a77-4f4c8696b542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:42.768680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097eb539-35ae-4ff9-8a77-4f4c8696b542 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:42.782666 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 462/923] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:42.788345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f3bde-06a9-4b5e-86b0-c125e8d12407 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:42.798289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f3bde-06a9-4b5e-86b0-c125e8d12407 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:42.802308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51d7f8-d7eb-4dd6-9520-da75bf24feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:42.803048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51d7f8-d7eb-4dd6-9520-da75bf24feb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:42.803337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51d7f8-d7eb-4dd6-9520-da75bf24feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:42.803618 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51d7f8-d7eb-4dd6-9520-da75bf24feb2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:42.816338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51d7f8-d7eb-4dd6-9520-da75bf24feb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:42.842219 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51d7f8-d7eb-4dd6-9520-da75bf24feb2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:42.861272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-8c51d7f8-d7eb-4dd6-9520-da75bf24feb2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:58:42.862413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 462/924] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:58:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:42.868246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097eb539-35ae-4ff9-8a77-4f4c8696b542 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:42.877718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097eb539-35ae-4ff9-8a77-4f4c8696b542 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:42.881885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65e0a9-a02a-4479-bc89-e8eb98870998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:42.882583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e0a9-a02a-4479-bc89-e8eb98870998 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:42.882914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e0a9-a02a-4479-bc89-e8eb98870998 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:42.883200 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e0a9-a02a-4479-bc89-e8eb98870998 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:42.884039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65e0a9-a02a-4479-bc89-e8eb98870998 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:42.884366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65e0a9-a02a-4479-bc89-e8eb98870998 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:42.910004 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65e0a9-a02a-4479-bc89-e8eb98870998 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:42.939361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 463/925] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Oct 27 13:58:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:42.945143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51d7f8-d7eb-4dd6-9520-da75bf24feb2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:42.954481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51d7f8-d7eb-4dd6-9520-da75bf24feb2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:42.958478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e7de5-093c-4907-8a82-63565339f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:42.959073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e7de5-093c-4907-8a82-63565339f7ac admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:42.959356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e7de5-093c-4907-8a82-63565339f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:42.959633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e7de5-093c-4907-8a82-63565339f7ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:42.967780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e7de5-093c-4907-8a82-63565339f7ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:42.993606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e7de5-093c-4907-8a82-63565339f7ac admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:43.003839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 463/926] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:58:42 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:58:43.010271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65e0a9-a02a-4479-bc89-e8eb98870998 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:43.019696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65e0a9-a02a-4479-bc89-e8eb98870998 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:43.023755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbe852-b851-4d55-a521-5d4272345e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:43.024465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbe852-b851-4d55-a521-5d4272345e14 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:43.024866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbe852-b851-4d55-a521-5d4272345e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:43.025638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbe852-b851-4d55-a521-5d4272345e14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:43.037285 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbe852-b851-4d55-a521-5d4272345e14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:43.063043 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbe852-b851-4d55-a521-5d4272345e14 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:43.080539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-09fbe852-b851-4d55-a521-5d4272345e14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:43.081648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 464/927] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:43.088154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e7de5-093c-4907-8a82-63565339f7ac admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:43.096918 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e7de5-093c-4907-8a82-63565339f7ac admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:43.101133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9027a5b-7c8b-493f-9be6-7713768bccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:43.101718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9027a5b-7c8b-493f-9be6-7713768bccea admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:43.102012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9027a5b-7c8b-493f-9be6-7713768bccea admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:43.102297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9027a5b-7c8b-493f-9be6-7713768bccea admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:43.103050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9027a5b-7c8b-493f-9be6-7713768bccea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:43.103395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9027a5b-7c8b-493f-9be6-7713768bccea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:43.128786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9027a5b-7c8b-493f-9be6-7713768bccea admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:43.143035 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 464/928] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:43.148583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbe852-b851-4d55-a521-5d4272345e14 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:43.158663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbe852-b851-4d55-a521-5d4272345e14 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:43.162749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0afb81-3e26-4514-be67-fd033f47e248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:43.163407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0afb81-3e26-4514-be67-fd033f47e248 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:43.163695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0afb81-3e26-4514-be67-fd033f47e248 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:43.163975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0afb81-3e26-4514-be67-fd033f47e248 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:43.173328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0afb81-3e26-4514-be67-fd033f47e248 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:43.199165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0afb81-3e26-4514-be67-fd033f47e248 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:43.213470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-7f0afb81-3e26-4514-be67-fd033f47e248 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:43.214566 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 465/929] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:43.220422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9027a5b-7c8b-493f-9be6-7713768bccea admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:43.229886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9027a5b-7c8b-493f-9be6-7713768bccea admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:43.234014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ddb47-945d-4f2d-b3cb-1f1ad267da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:43.234886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ddb47-945d-4f2d-b3cb-1f1ad267da45 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:43.235183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ddb47-945d-4f2d-b3cb-1f1ad267da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:43.235469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ddb47-945d-4f2d-b3cb-1f1ad267da45 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:43.236205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ddb47-945d-4f2d-b3cb-1f1ad267da45 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:43.236510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ddb47-945d-4f2d-b3cb-1f1ad267da45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:43.262430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ddb47-945d-4f2d-b3cb-1f1ad267da45 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:43.276355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 465/930] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:58:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:58:43.283719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0afb81-3e26-4514-be67-fd033f47e248 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:43.293430 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0afb81-3e26-4514-be67-fd033f47e248 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:43.297578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600cc8b-3eef-4d50-bac2-af62a1ff233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:43.298160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600cc8b-3eef-4d50-bac2-af62a1ff233f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:43.298451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600cc8b-3eef-4d50-bac2-af62a1ff233f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:43.298771 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600cc8b-3eef-4d50-bac2-af62a1ff233f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:43.299554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600cc8b-3eef-4d50-bac2-af62a1ff233f admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=e56f87a3cc4c4503a156700b66525530) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:43.299863 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600cc8b-3eef-4d50-bac2-af62a1ff233f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:43.326077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600cc8b-3eef-4d50-bac2-af62a1ff233f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:43.331882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 466/931] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:58:43 2021] GET /identity/v3/role_assignments?user.id=e56f87a3cc4c4503a156700b66525530&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:45.289179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac50f1-3b27-4572-938f-2b64ed7d5495 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.289692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac50f1-3b27-4572-938f-2b64ed7d5495 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.289692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac50f1-3b27-4572-938f-2b64ed7d5495 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.292440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 466/932] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:45.297956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591972ab-2266-490e-88f2-8d240ba23441 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.298387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591972ab-2266-490e-88f2-8d240ba23441 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.298539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591972ab-2266-490e-88f2-8d240ba23441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.322076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-591972ab-2266-490e-88f2-8d240ba23441 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:45.323262 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-591972ab-2266-490e-88f2-8d240ba23441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:45.330041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 467/933] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:45.351787 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac50f1-3b27-4572-938f-2b64ed7d5495 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.364670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac50f1-3b27-4572-938f-2b64ed7d5495 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.369306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479ca06-72b7-4531-b4f2-853445dee1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.370022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ca06-72b7-4531-b4f2-853445dee1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.370314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ca06-72b7-4531-b4f2-853445dee1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.370596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ca06-72b7-4531-b4f2-853445dee1f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.381663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479ca06-72b7-4531-b4f2-853445dee1f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:45.387938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-5479ca06-72b7-4531-b4f2-853445dee1f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:58:45.389048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 467/934] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:45.397053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591972ab-2266-490e-88f2-8d240ba23441 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.405714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591972ab-2266-490e-88f2-8d240ba23441 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.409763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128201af-5e82-4254-b42f-f806c1b74d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.410356 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128201af-5e82-4254-b42f-f806c1b74d89 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.410658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128201af-5e82-4254-b42f-f806c1b74d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.410948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128201af-5e82-4254-b42f-f806c1b74d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.411652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128201af-5e82-4254-b42f-f806c1b74d89 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:45.411951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128201af-5e82-4254-b42f-f806c1b74d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:45.438015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128201af-5e82-4254-b42f-f806c1b74d89 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:45.447023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 468/935] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:58:45.453230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479ca06-72b7-4531-b4f2-853445dee1f5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.463127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479ca06-72b7-4531-b4f2-853445dee1f5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.467232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa7cc-cac9-4872-9d31-6837e7dd22c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.467942 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa7cc-cac9-4872-9d31-6837e7dd22c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.468231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa7cc-cac9-4872-9d31-6837e7dd22c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.468519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa7cc-cac9-4872-9d31-6837e7dd22c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.480147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faa7cc-cac9-4872-9d31-6837e7dd22c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:45.506200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faa7cc-cac9-4872-9d31-6837e7dd22c3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:45.526549 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-73faa7cc-cac9-4872-9d31-6837e7dd22c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:45.527857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 468/936] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:45.533678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128201af-5e82-4254-b42f-f806c1b74d89 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.543846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128201af-5e82-4254-b42f-f806c1b74d89 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.547775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6da7a2-aaeb-4005-801f-67f412cbf399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.548355 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6da7a2-aaeb-4005-801f-67f412cbf399 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.548644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6da7a2-aaeb-4005-801f-67f412cbf399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.548926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6da7a2-aaeb-4005-801f-67f412cbf399 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.549603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6da7a2-aaeb-4005-801f-67f412cbf399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:45.549900 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6da7a2-aaeb-4005-801f-67f412cbf399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:45.575520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6da7a2-aaeb-4005-801f-67f412cbf399 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:45.593501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 469/937] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:45.599339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa7cc-cac9-4872-9d31-6837e7dd22c3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.609207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa7cc-cac9-4872-9d31-6837e7dd22c3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.613823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7f3ea-df35-41c7-90ee-c82d7bdd8f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.614540 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7f3ea-df35-41c7-90ee-c82d7bdd8f38 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.614863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7f3ea-df35-41c7-90ee-c82d7bdd8f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.615149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7f3ea-df35-41c7-90ee-c82d7bdd8f38 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.629965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7f3ea-df35-41c7-90ee-c82d7bdd8f38 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:45.656057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7f3ea-df35-41c7-90ee-c82d7bdd8f38 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:45.674429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-a4e7f3ea-df35-41c7-90ee-c82d7bdd8f38 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:58:45.675561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 469/938] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/users/swift => generated 83 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:45.682004 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6da7a2-aaeb-4005-801f-67f412cbf399 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.691571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6da7a2-aaeb-4005-801f-67f412cbf399 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.695621 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e5eaf-e32d-4037-83a6-65600074536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.696215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e5eaf-e32d-4037-83a6-65600074536c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.696550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e5eaf-e32d-4037-83a6-65600074536c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.696835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e5eaf-e32d-4037-83a6-65600074536c admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.697621 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e5eaf-e32d-4037-83a6-65600074536c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:45.697919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e5eaf-e32d-4037-83a6-65600074536c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:45.723690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e5eaf-e32d-4037-83a6-65600074536c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:45.753387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 470/939] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:45.759367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7f3ea-df35-41c7-90ee-c82d7bdd8f38 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.768761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7f3ea-df35-41c7-90ee-c82d7bdd8f38 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.772953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac6179-51ac-401d-aab2-4eae2d9ee776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.773664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac6179-51ac-401d-aab2-4eae2d9ee776 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.773953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac6179-51ac-401d-aab2-4eae2d9ee776 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.774232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac6179-51ac-401d-aab2-4eae2d9ee776 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.787144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac6179-51ac-401d-aab2-4eae2d9ee776 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:45.813310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac6179-51ac-401d-aab2-4eae2d9ee776 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:45.830703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-39ac6179-51ac-401d-aab2-4eae2d9ee776 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:45.831838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 470/940] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:45.838224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e5eaf-e32d-4037-83a6-65600074536c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.847774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e5eaf-e32d-4037-83a6-65600074536c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.851938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1ec65-66e2-4179-9392-9839256680f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.852528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1ec65-66e2-4179-9392-9839256680f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.853407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1ec65-66e2-4179-9392-9839256680f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.853696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1ec65-66e2-4179-9392-9839256680f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.854387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1ec65-66e2-4179-9392-9839256680f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:45.854726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1ec65-66e2-4179-9392-9839256680f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:45.880060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1ec65-66e2-4179-9392-9839256680f4 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:45.894553 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 471/941] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:45.901177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac6179-51ac-401d-aab2-4eae2d9ee776 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.910759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac6179-51ac-401d-aab2-4eae2d9ee776 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.915011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9eb9d-7d9f-44e8-b536-77e424ddf116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.916321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9eb9d-7d9f-44e8-b536-77e424ddf116 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.916613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9eb9d-7d9f-44e8-b536-77e424ddf116 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.916895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9eb9d-7d9f-44e8-b536-77e424ddf116 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.925835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9eb9d-7d9f-44e8-b536-77e424ddf116 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:45.951909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9eb9d-7d9f-44e8-b536-77e424ddf116 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:45.970122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-5fe9eb9d-7d9f-44e8-b536-77e424ddf116 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:45.971502 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 471/942] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:45.977393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1ec65-66e2-4179-9392-9839256680f4 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:45.987958 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1ec65-66e2-4179-9392-9839256680f4 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:45.992533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d987c9-a382-416f-8873-ee0f7bf6ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:45.993251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d987c9-a382-416f-8873-ee0f7bf6ffec admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:45.993611 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d987c9-a382-416f-8873-ee0f7bf6ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:45.993960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d987c9-a382-416f-8873-ee0f7bf6ffec admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:45.994808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d987c9-a382-416f-8873-ee0f7bf6ffec admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:45.995178 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d987c9-a382-416f-8873-ee0f7bf6ffec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:46.020984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d987c9-a382-416f-8873-ee0f7bf6ffec admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:46.036361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 472/943] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:58:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:46.042430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9eb9d-7d9f-44e8-b536-77e424ddf116 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:46.051780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9eb9d-7d9f-44e8-b536-77e424ddf116 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:46.055926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad1c9b-2730-4a78-8fce-c326769fd47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:46.056818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad1c9b-2730-4a78-8fce-c326769fd47e admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:46.057106 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad1c9b-2730-4a78-8fce-c326769fd47e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:46.057395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad1c9b-2730-4a78-8fce-c326769fd47e admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/e56f87a3cc4c4503a156700b66525530/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:46.059183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad1c9b-2730-4a78-8fce-c326769fd47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=e56f87a3cc4c4503a156700b66525530, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:46.085726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad1c9b-2730-4a78-8fce-c326769fd47e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:46.099466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 472/944] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:58:46 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/e56f87a3cc4c4503a156700b66525530/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:58:48.288304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef5fd4-0533-4730-925c-6330634d9a99 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.288832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef5fd4-0533-4730-925c-6330634d9a99 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.288832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef5fd4-0533-4730-925c-6330634d9a99 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.290430 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 473/945] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:48.295885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5dd2-e522-4a9b-b627-c37aeadd3b1c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.296322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5dd2-e522-4a9b-b627-c37aeadd3b1c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.296469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5dd2-e522-4a9b-b627-c37aeadd3b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.318721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-df3a5dd2-e522-4a9b-b627-c37aeadd3b1c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:48.319856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-df3a5dd2-e522-4a9b-b627-c37aeadd3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:48.384684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 473/946] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:48.407454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef5fd4-0533-4730-925c-6330634d9a99 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:48.419442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef5fd4-0533-4730-925c-6330634d9a99 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:48.423404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad69e0-f0fd-4abf-beb2-53aa5635a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:48.424109 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad69e0-f0fd-4abf-beb2-53aa5635a74a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.424394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad69e0-f0fd-4abf-beb2-53aa5635a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.424672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad69e0-f0fd-4abf-beb2-53aa5635a74a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.435830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad69e0-f0fd-4abf-beb2-53aa5635a74a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:58:48.441926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-adad69e0-f0fd-4abf-beb2-53aa5635a74a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:58:48.443035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 474/947] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:58:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:48.450189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5dd2-e522-4a9b-b627-c37aeadd3b1c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:48.458786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5dd2-e522-4a9b-b627-c37aeadd3b1c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:48.463651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c1a8b-e1c5-43eb-a5c0-134dfc3e8574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:48.464242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c1a8b-e1c5-43eb-a5c0-134dfc3e8574 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.464531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c1a8b-e1c5-43eb-a5c0-134dfc3e8574 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.464864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c1a8b-e1c5-43eb-a5c0-134dfc3e8574 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.465518 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c1a8b-e1c5-43eb-a5c0-134dfc3e8574 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:48.465812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c1a8b-e1c5-43eb-a5c0-134dfc3e8574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:48.491081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c1a8b-e1c5-43eb-a5c0-134dfc3e8574 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:48.500224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 474/948] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:58:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:48.506133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad69e0-f0fd-4abf-beb2-53aa5635a74a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:48.516805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad69e0-f0fd-4abf-beb2-53aa5635a74a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:48.520810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35496a6-022e-4566-9780-65be5e6e96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:48.521505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35496a6-022e-4566-9780-65be5e6e96ae admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.521792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35496a6-022e-4566-9780-65be5e6e96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.522161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35496a6-022e-4566-9780-65be5e6e96ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.541328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35496a6-022e-4566-9780-65be5e6e96ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:48.567102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35496a6-022e-4566-9780-65be5e6e96ae admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:48.586007 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-a35496a6-022e-4566-9780-65be5e6e96ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:48.587814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 475/949] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:58:48.593813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c1a8b-e1c5-43eb-a5c0-134dfc3e8574 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:48.603226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c1a8b-e1c5-43eb-a5c0-134dfc3e8574 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:48.607327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7bc88-87b9-418c-a4de-6ad5700442c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:48.607911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7bc88-87b9-418c-a4de-6ad5700442c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.608230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7bc88-87b9-418c-a4de-6ad5700442c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.608479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7bc88-87b9-418c-a4de-6ad5700442c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.609170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7bc88-87b9-418c-a4de-6ad5700442c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:48.609721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7bc88-87b9-418c-a4de-6ad5700442c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:48.635732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7bc88-87b9-418c-a4de-6ad5700442c5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:48.648729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 475/950] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:58:48.654540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35496a6-022e-4566-9780-65be5e6e96ae admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:48.663869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35496a6-022e-4566-9780-65be5e6e96ae admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:48.668177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da3cec-1335-48b4-a571-072ece782332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:48.668877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da3cec-1335-48b4-a571-072ece782332 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.669160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da3cec-1335-48b4-a571-072ece782332 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.669441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da3cec-1335-48b4-a571-072ece782332 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.682617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da3cec-1335-48b4-a571-072ece782332 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:48.708453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da3cec-1335-48b4-a571-072ece782332 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:48.726260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-33da3cec-1335-48b4-a571-072ece782332 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 13:58:48.727377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 476/951] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:58:48 2021] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:58:48.733488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7bc88-87b9-418c-a4de-6ad5700442c5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:48.743606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7bc88-87b9-418c-a4de-6ad5700442c5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:48.747987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56992458-5239-4f18-aff4-62f57f0f520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:48.748580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56992458-5239-4f18-aff4-62f57f0f520e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.748875 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56992458-5239-4f18-aff4-62f57f0f520e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.749215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56992458-5239-4f18-aff4-62f57f0f520e admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.749965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56992458-5239-4f18-aff4-62f57f0f520e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:48.750269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56992458-5239-4f18-aff4-62f57f0f520e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:48.776860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56992458-5239-4f18-aff4-62f57f0f520e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:48.806257 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 476/952] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Oct 27 13:58:48 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:48.812230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da3cec-1335-48b4-a571-072ece782332 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:48.823589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da3cec-1335-48b4-a571-072ece782332 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:48.828062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f37d5-43e4-48fc-9d4c-402b6ff9178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:48.828734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f37d5-43e4-48fc-9d4c-402b6ff9178c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.829039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f37d5-43e4-48fc-9d4c-402b6ff9178c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.829337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f37d5-43e4-48fc-9d4c-402b6ff9178c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.838422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f37d5-43e4-48fc-9d4c-402b6ff9178c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:48.866850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f37d5-43e4-48fc-9d4c-402b6ff9178c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:48.878817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 477/953] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:58:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:58:48.885334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56992458-5239-4f18-aff4-62f57f0f520e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:48.894760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56992458-5239-4f18-aff4-62f57f0f520e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:48.898906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9538fd-5fb6-418a-8005-68a08d4c65b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:48.899655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9538fd-5fb6-418a-8005-68a08d4c65b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.899941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9538fd-5fb6-418a-8005-68a08d4c65b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.900221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9538fd-5fb6-418a-8005-68a08d4c65b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.916938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9538fd-5fb6-418a-8005-68a08d4c65b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:48.943958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9538fd-5fb6-418a-8005-68a08d4c65b8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:48.962776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-ba9538fd-5fb6-418a-8005-68a08d4c65b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 13:58:48.963915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 477/954] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:58:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:58:48.969682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f37d5-43e4-48fc-9d4c-402b6ff9178c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:48.978924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f37d5-43e4-48fc-9d4c-402b6ff9178c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:48.983185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03809e-ecae-4332-abbf-a818a9bde6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:48.983768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03809e-ecae-4332-abbf-a818a9bde6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:48.984050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03809e-ecae-4332-abbf-a818a9bde6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:48.984327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03809e-ecae-4332-abbf-a818a9bde6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:48.985272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03809e-ecae-4332-abbf-a818a9bde6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:48.985568 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03809e-ecae-4332-abbf-a818a9bde6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:49.011133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03809e-ecae-4332-abbf-a818a9bde6e8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:49.024344 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 478/955] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 13:58:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:49.030578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9538fd-5fb6-418a-8005-68a08d4c65b8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:49.047714 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9538fd-5fb6-418a-8005-68a08d4c65b8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:49.051873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e201c3a-5a95-4402-9626-fbb12b5f3057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:49.052588 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e201c3a-5a95-4402-9626-fbb12b5f3057 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:49.052876 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e201c3a-5a95-4402-9626-fbb12b5f3057 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:49.053157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e201c3a-5a95-4402-9626-fbb12b5f3057 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:49.063367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e201c3a-5a95-4402-9626-fbb12b5f3057 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:49.089307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e201c3a-5a95-4402-9626-fbb12b5f3057 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:49.103565 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-7e201c3a-5a95-4402-9626-fbb12b5f3057 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 13:58:49.104671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 478/956] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 13:58:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:49.111823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03809e-ecae-4332-abbf-a818a9bde6e8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:49.123523 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03809e-ecae-4332-abbf-a818a9bde6e8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:49.128458 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc89f2-0277-4e3d-9dbc-2acefefffb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:49.129366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc89f2-0277-4e3d-9dbc-2acefefffb47 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:49.129718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc89f2-0277-4e3d-9dbc-2acefefffb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:49.130057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc89f2-0277-4e3d-9dbc-2acefefffb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:49.130931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc89f2-0277-4e3d-9dbc-2acefefffb47 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:49.131293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc89f2-0277-4e3d-9dbc-2acefefffb47 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:49.161852 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc89f2-0277-4e3d-9dbc-2acefefffb47 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:49.177417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 479/957] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 13:58:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:49.184105 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e201c3a-5a95-4402-9626-fbb12b5f3057 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:49.193902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e201c3a-5a95-4402-9626-fbb12b5f3057 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:49.197949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c46022-e3b8-46b3-a7d8-0bee744acd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:49.198520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c46022-e3b8-46b3-a7d8-0bee744acd0c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:49.198831 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c46022-e3b8-46b3-a7d8-0bee744acd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:49.199110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c46022-e3b8-46b3-a7d8-0bee744acd0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:49.199884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c46022-e3b8-46b3-a7d8-0bee744acd0c admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=e56f87a3cc4c4503a156700b66525530) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:49.200185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c46022-e3b8-46b3-a7d8-0bee744acd0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:49.225276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c46022-e3b8-46b3-a7d8-0bee744acd0c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:49.231887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 479/958] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:58:49 2021] GET /identity/v3/role_assignments?user.id=e56f87a3cc4c4503a156700b66525530&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:58:51.204593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa00d-c147-428e-8318-fb9478fba736 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:51.205135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa00d-c147-428e-8318-fb9478fba736 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:51.205135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa00d-c147-428e-8318-fb9478fba736 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:51.206887 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 480/959] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:51.213520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5875b-9112-4eeb-909a-58f51ae76a67 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:51.214036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5875b-9112-4eeb-909a-58f51ae76a67 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:51.214136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5875b-9112-4eeb-909a-58f51ae76a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:51.237689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-b5c5875b-9112-4eeb-909a-58f51ae76a67 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:51.238862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b5c5875b-9112-4eeb-909a-58f51ae76a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:51.246356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 480/960] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:51.268934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa00d-c147-428e-8318-fb9478fba736 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:51.281419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa00d-c147-428e-8318-fb9478fba736 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:51.285718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67358cfa-2f91-4749-86ff-8a3c2b12609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:51.286470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358cfa-2f91-4749-86ff-8a3c2b12609e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:51.286795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358cfa-2f91-4749-86ff-8a3c2b12609e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:51.287112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358cfa-2f91-4749-86ff-8a3c2b12609e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:51.287746 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67358cfa-2f91-4749-86ff-8a3c2b12609e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:51.313079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67358cfa-2f91-4749-86ff-8a3c2b12609e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:51.325137 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-67358cfa-2f91-4749-86ff-8a3c2b12609e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:58:51.326342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 481/961] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:58:51 2021] GET /identity/v3/services/object-store => generated 93 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:51.332902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5875b-9112-4eeb-909a-58f51ae76a67 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:51.342868 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5875b-9112-4eeb-909a-58f51ae76a67 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:51.347157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d15f6-f0a1-4e23-ad04-61c5b7b5a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:51.347775 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d15f6-f0a1-4e23-ad04-61c5b7b5a6da admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:51.348070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d15f6-f0a1-4e23-ad04-61c5b7b5a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:51.348356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d15f6-f0a1-4e23-ad04-61c5b7b5a6da admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:51.349053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d15f6-f0a1-4e23-ad04-61c5b7b5a6da admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:51.349356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d15f6-f0a1-4e23-ad04-61c5b7b5a6da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:51.375819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d15f6-f0a1-4e23-ad04-61c5b7b5a6da admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:51.381276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 481/962] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:58:51 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:51.388277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67358cfa-2f91-4749-86ff-8a3c2b12609e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:51.397921 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67358cfa-2f91-4749-86ff-8a3c2b12609e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:51.402969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62835617-7636-4834-abc7-e833168fc48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:51.403562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62835617-7636-4834-abc7-e833168fc48c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:51.403858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62835617-7636-4834-abc7-e833168fc48c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:51.404143 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62835617-7636-4834-abc7-e833168fc48c admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:51.404821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62835617-7636-4834-abc7-e833168fc48c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:51.405123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62835617-7636-4834-abc7-e833168fc48c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:51.430341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62835617-7636-4834-abc7-e833168fc48c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:51.435461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 482/963] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:58:51 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:53.502867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aed88-f4fe-47d7-8b12-37a75cf46028 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:53.503399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aed88-f4fe-47d7-8b12-37a75cf46028 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:53.503593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aed88-f4fe-47d7-8b12-37a75cf46028 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:53.505825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 482/964] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:53.511643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50026324-beec-4f12-9870-6fedd257de6c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:53.512064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50026324-beec-4f12-9870-6fedd257de6c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:53.512223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50026324-beec-4f12-9870-6fedd257de6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:53.535299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-50026324-beec-4f12-9870-6fedd257de6c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:53.536445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-50026324-beec-4f12-9870-6fedd257de6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:53.543528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 483/965] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:58:53.565491 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aed88-f4fe-47d7-8b12-37a75cf46028 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:53.577945 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aed88-f4fe-47d7-8b12-37a75cf46028 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:53.581979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82f47e-80ff-4d59-9975-97b4d8138fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:53.582572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82f47e-80ff-4d59-9975-97b4d8138fba admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:53.582900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82f47e-80ff-4d59-9975-97b4d8138fba admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:53.583187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82f47e-80ff-4d59-9975-97b4d8138fba admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:53.583867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82f47e-80ff-4d59-9975-97b4d8138fba admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:53.609964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82f47e-80ff-4d59-9975-97b4d8138fba admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:53.623531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 483/966] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:58:53 2021] POST /identity/v3/services => generated 241 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:58:55.596767 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932526-1421-4dca-8b7d-4feb463180a5 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:55.597358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932526-1421-4dca-8b7d-4feb463180a5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:55.597358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b932526-1421-4dca-8b7d-4feb463180a5 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:55.599065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 484/967] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:55.605224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40c9c-135b-4e92-ba81-23d2783e664c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:55.605745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40c9c-135b-4e92-ba81-23d2783e664c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:55.605902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40c9c-135b-4e92-ba81-23d2783e664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:55.630849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7ca40c9c-135b-4e92-ba81-23d2783e664c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:55.632000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7ca40c9c-135b-4e92-ba81-23d2783e664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:55.650377 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 484/968] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:55 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:58:55.672475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932526-1421-4dca-8b7d-4feb463180a5 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:55.684312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b932526-1421-4dca-8b7d-4feb463180a5 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:55.688266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446406e5-66d6-4998-b518-30123f1e1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:55.688986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446406e5-66d6-4998-b518-30123f1e1302 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:55.689278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446406e5-66d6-4998-b518-30123f1e1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:55.689561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446406e5-66d6-4998-b518-30123f1e1302 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:55.690184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446406e5-66d6-4998-b518-30123f1e1302 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:55.716307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446406e5-66d6-4998-b518-30123f1e1302 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:55.727152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-446406e5-66d6-4998-b518-30123f1e1302 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:58:55.728947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 485/969] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:58:55 2021] GET /identity/v3/services/object-store => generated 93 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:55.735259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca40c9c-135b-4e92-ba81-23d2783e664c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:55.744309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca40c9c-135b-4e92-ba81-23d2783e664c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:55.748367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8a9e-1a43-4abd-97cd-69f7531f41e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:55.748956 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8a9e-1a43-4abd-97cd-69f7531f41e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:55.749250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8a9e-1a43-4abd-97cd-69f7531f41e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:55.749529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8a9e-1a43-4abd-97cd-69f7531f41e3 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:55.750200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8a9e-1a43-4abd-97cd-69f7531f41e3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:55.750494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8a9e-1a43-4abd-97cd-69f7531f41e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:55.777096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8a9e-1a43-4abd-97cd-69f7531f41e3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:55.782015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 485/970] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:58:55 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:55.787670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446406e5-66d6-4998-b518-30123f1e1302 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:55.797232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446406e5-66d6-4998-b518-30123f1e1302 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:55.801076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc944c-6aee-4b7c-b8b2-651d3b26dbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:55.801664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc944c-6aee-4b7c-b8b2-651d3b26dbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:55.801957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc944c-6aee-4b7c-b8b2-651d3b26dbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:55.802243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc944c-6aee-4b7c-b8b2-651d3b26dbe8 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:55.802944 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc944c-6aee-4b7c-b8b2-651d3b26dbe8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:55.803250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc944c-6aee-4b7c-b8b2-651d3b26dbe8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:55.829014 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc944c-6aee-4b7c-b8b2-651d3b26dbe8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:55.834438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 486/971] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:58:55 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:55.841273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8a9e-1a43-4abd-97cd-69f7531f41e3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:55.850684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8a9e-1a43-4abd-97cd-69f7531f41e3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:55.854990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc260ce7-a724-4fd3-8828-efb026bc83e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:55.855588 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc260ce7-a724-4fd3-8828-efb026bc83e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:55.855883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc260ce7-a724-4fd3-8828-efb026bc83e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:55.856163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc260ce7-a724-4fd3-8828-efb026bc83e0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:55.856916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc260ce7-a724-4fd3-8828-efb026bc83e0 admin admin] RBAC: Adding query filter params (interface=public, service_id=a401045f398044a8813439d55f9e781c, region_id=RegionOne) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:55.857214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc260ce7-a724-4fd3-8828-efb026bc83e0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:55.882671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc260ce7-a724-4fd3-8828-efb026bc83e0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:55.889099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 486/972] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Oct 27 13:58:55 2021] GET /identity/v3/endpoints?service_id=a401045f398044a8813439d55f9e781c&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:58:55.895196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc944c-6aee-4b7c-b8b2-651d3b26dbe8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:55.905394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc944c-6aee-4b7c-b8b2-651d3b26dbe8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:55.909436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b99cb-1905-467e-be99-40664d2e23fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:55.910021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b99cb-1905-467e-be99-40664d2e23fd admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:55.910313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b99cb-1905-467e-be99-40664d2e23fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:55.910594 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b99cb-1905-467e-be99-40664d2e23fd admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:55.911272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b99cb-1905-467e-be99-40664d2e23fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:55.936391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b99cb-1905-467e-be99-40664d2e23fd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:55.943420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 487/973] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 13:58:55 2021] GET /identity/v3/services => generated 2196 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:58:57.931702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f455f-09a1-4b65-a51b-e1ba58d33e45 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:57.932234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f455f-09a1-4b65-a51b-e1ba58d33e45 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:57.932322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f455f-09a1-4b65-a51b-e1ba58d33e45 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:57.933941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 487/974] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:58:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:58:57.939189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0b990-0c66-4664-b899-6bc437e13187 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:57.939612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0b990-0c66-4664-b899-6bc437e13187 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:57.939764 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0b990-0c66-4664-b899-6bc437e13187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:57.962101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-90b0b990-0c66-4664-b899-6bc437e13187 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:58:57.963240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-90b0b990-0c66-4664-b899-6bc437e13187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:58:57.969938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 488/975] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:58:57 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:58:57.992032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f455f-09a1-4b65-a51b-e1ba58d33e45 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:58.004545 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f455f-09a1-4b65-a51b-e1ba58d33e45 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:58.010014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ec9c6-a664-4f37-bf44-7f499d88d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:58.010597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ec9c6-a664-4f37-bf44-7f499d88d8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:58.010944 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ec9c6-a664-4f37-bf44-7f499d88d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:58.011226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ec9c6-a664-4f37-bf44-7f499d88d8a2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:58.011853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ec9c6-a664-4f37-bf44-7f499d88d8a2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:58.037534 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ec9c6-a664-4f37-bf44-7f499d88d8a2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:58.048799 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-701ec9c6-a664-4f37-bf44-7f499d88d8a2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:58:58.049883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 488/976] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:58:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:58:58.055984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0b990-0c66-4664-b899-6bc437e13187 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:58.064686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0b990-0c66-4664-b899-6bc437e13187 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:58.068766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc399ab2-f2ee-441e-a40e-8db44b0bcd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:58.069350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399ab2-f2ee-441e-a40e-8db44b0bcd53 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:58.069642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399ab2-f2ee-441e-a40e-8db44b0bcd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:58.069927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399ab2-f2ee-441e-a40e-8db44b0bcd53 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:58.070601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc399ab2-f2ee-441e-a40e-8db44b0bcd53 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:58.071494 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc399ab2-f2ee-441e-a40e-8db44b0bcd53 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:58.097407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc399ab2-f2ee-441e-a40e-8db44b0bcd53 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:58.102357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 489/977] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:58:58 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:58.108041 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ec9c6-a664-4f37-bf44-7f499d88d8a2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:58.117481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ec9c6-a664-4f37-bf44-7f499d88d8a2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:58.123114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48486a4-e704-495e-bb61-4aae8744b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:58.124089 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48486a4-e704-495e-bb61-4aae8744b924 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:58.124470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48486a4-e704-495e-bb61-4aae8744b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:58.124764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48486a4-e704-495e-bb61-4aae8744b924 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:58.125445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48486a4-e704-495e-bb61-4aae8744b924 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:58:58.125749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48486a4-e704-495e-bb61-4aae8744b924 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:58.151890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48486a4-e704-495e-bb61-4aae8744b924 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:58.156917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 489/978] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:58:58 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:58:58.162785 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc399ab2-f2ee-441e-a40e-8db44b0bcd53 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:58:58.172463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc399ab2-f2ee-441e-a40e-8db44b0bcd53 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:58:58.176583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2b3ae-8947-482a-97a2-f8addeda6900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:58:58.177162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b3ae-8947-482a-97a2-f8addeda6900 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:58:58.177457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b3ae-8947-482a-97a2-f8addeda6900 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:58:58.177743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b3ae-8947-482a-97a2-f8addeda6900 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:58:58.178431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2b3ae-8947-482a-97a2-f8addeda6900 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:58:58.204151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2b3ae-8947-482a-97a2-f8addeda6900 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:58:58.222456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 490/979] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 13:58:58 2021] POST /identity/v3/endpoints => generated 349 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:59:00.172329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf87e37-27cc-4154-b817-23df7c8d709e None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:00.172851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf87e37-27cc-4154-b817-23df7c8d709e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:00.172935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf87e37-27cc-4154-b817-23df7c8d709e None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:00.174552 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 490/980] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:00.179899 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18520dee-0d69-41c2-95d9-a849f676b580 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:00.180319 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18520dee-0d69-41c2-95d9-a849f676b580 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:00.180568 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18520dee-0d69-41c2-95d9-a849f676b580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:00.202871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-18520dee-0d69-41c2-95d9-a849f676b580 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:00.204030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-18520dee-0d69-41c2-95d9-a849f676b580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:00.221623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 491/981] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:00 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:00.244135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf87e37-27cc-4154-b817-23df7c8d709e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:00.255723 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf87e37-27cc-4154-b817-23df7c8d709e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:00.260287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ffd8c-9050-4119-917e-08d9261fef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:00.260958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ffd8c-9050-4119-917e-08d9261fef37 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:00.261249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ffd8c-9050-4119-917e-08d9261fef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:00.261540 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ffd8c-9050-4119-917e-08d9261fef37 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:00.262154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ffd8c-9050-4119-917e-08d9261fef37 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:00.287667 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ffd8c-9050-4119-917e-08d9261fef37 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:00.298334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-470ffd8c-9050-4119-917e-08d9261fef37 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:59:00.299430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 491/982] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:59:00 2021] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:00.305601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18520dee-0d69-41c2-95d9-a849f676b580 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:00.314429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18520dee-0d69-41c2-95d9-a849f676b580 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:00.318479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b04088-f451-4b8b-b426-89236af3a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:00.319093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b04088-f451-4b8b-b426-89236af3a794 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:00.319387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b04088-f451-4b8b-b426-89236af3a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:00.319672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b04088-f451-4b8b-b426-89236af3a794 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:00.320343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b04088-f451-4b8b-b426-89236af3a794 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:00.320647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b04088-f451-4b8b-b426-89236af3a794 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:00.347470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b04088-f451-4b8b-b426-89236af3a794 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:00.352942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 492/983] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:59:00 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:00.358876 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ffd8c-9050-4119-917e-08d9261fef37 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:00.369496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ffd8c-9050-4119-917e-08d9261fef37 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:00.373677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a94a8-ddd2-4d05-8b59-193745f3004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:00.374302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a94a8-ddd2-4d05-8b59-193745f3004a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:00.374692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a94a8-ddd2-4d05-8b59-193745f3004a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:00.375018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a94a8-ddd2-4d05-8b59-193745f3004a admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:00.375689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a94a8-ddd2-4d05-8b59-193745f3004a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:00.376075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a94a8-ddd2-4d05-8b59-193745f3004a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:00.402238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a94a8-ddd2-4d05-8b59-193745f3004a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:00.406994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 492/984] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:59:00 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:00.412809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b04088-f451-4b8b-b426-89236af3a794 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:00.421993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b04088-f451-4b8b-b426-89236af3a794 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:00.425980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adec38-779e-463d-8032-0d10fcc0353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:00.426551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adec38-779e-463d-8032-0d10fcc0353c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:00.426873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adec38-779e-463d-8032-0d10fcc0353c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:00.427155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adec38-779e-463d-8032-0d10fcc0353c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:00.427891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adec38-779e-463d-8032-0d10fcc0353c admin admin] RBAC: Adding query filter params (interface=admin, service_id=a401045f398044a8813439d55f9e781c, region_id=RegionOne) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:00.428197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adec38-779e-463d-8032-0d10fcc0353c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:00.453728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adec38-779e-463d-8032-0d10fcc0353c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:00.459106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 493/985] 10.222.0.36 () {56 vars in 1270 bytes} [Wed Oct 27 13:59:00 2021] GET /identity/v3/endpoints?service_id=a401045f398044a8813439d55f9e781c&interface=admin®ion_id=RegionOne => generated 193 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:00.465385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a94a8-ddd2-4d05-8b59-193745f3004a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:00.474892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a94a8-ddd2-4d05-8b59-193745f3004a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:00.479319 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80e789-c345-4ca4-8e31-4ce22be2d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:00.479912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80e789-c345-4ca4-8e31-4ce22be2d43f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:00.480206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80e789-c345-4ca4-8e31-4ce22be2d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:00.480494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80e789-c345-4ca4-8e31-4ce22be2d43f admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:00.481142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80e789-c345-4ca4-8e31-4ce22be2d43f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:00.506737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80e789-c345-4ca4-8e31-4ce22be2d43f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:00.514297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 493/986] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 13:59:00 2021] GET /identity/v3/services => generated 2196 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 13:59:02.504853 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74b614-5a57-4641-969a-92d81a92beb9 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:02.505436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74b614-5a57-4641-969a-92d81a92beb9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:02.505436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74b614-5a57-4641-969a-92d81a92beb9 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:02.507265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 494/987] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:02.513080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805d51-a189-47be-84ca-ab905c4ed966 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:02.513520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805d51-a189-47be-84ca-ab905c4ed966 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:02.513658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805d51-a189-47be-84ca-ab905c4ed966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:02.536295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-9a805d51-a189-47be-84ca-ab905c4ed966 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:02.537430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9a805d51-a189-47be-84ca-ab905c4ed966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:02.544275 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 494/988] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:02 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:02.566294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74b614-5a57-4641-969a-92d81a92beb9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:02.578435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74b614-5a57-4641-969a-92d81a92beb9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:02.582364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafc0da-01f7-41b5-8a95-d0a5ee7c2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:02.583110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafc0da-01f7-41b5-8a95-d0a5ee7c2e8f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:02.583408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafc0da-01f7-41b5-8a95-d0a5ee7c2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:02.583692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafc0da-01f7-41b5-8a95-d0a5ee7c2e8f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:02.584307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafc0da-01f7-41b5-8a95-d0a5ee7c2e8f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:02.610469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafc0da-01f7-41b5-8a95-d0a5ee7c2e8f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:02.621242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-3fafc0da-01f7-41b5-8a95-d0a5ee7c2e8f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 13:59:02.622320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 495/989] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Oct 27 13:59:02 2021] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:02.628532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805d51-a189-47be-84ca-ab905c4ed966 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:02.638069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805d51-a189-47be-84ca-ab905c4ed966 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:02.642129 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92979a13-1a6a-432e-bfac-a3c01fa73311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:02.642756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92979a13-1a6a-432e-bfac-a3c01fa73311 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:02.643047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92979a13-1a6a-432e-bfac-a3c01fa73311 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:02.643333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92979a13-1a6a-432e-bfac-a3c01fa73311 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:02.644003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92979a13-1a6a-432e-bfac-a3c01fa73311 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:02.644305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92979a13-1a6a-432e-bfac-a3c01fa73311 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:02.670677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92979a13-1a6a-432e-bfac-a3c01fa73311 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:02.675560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 495/990] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:59:02 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:02.681577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafc0da-01f7-41b5-8a95-d0a5ee7c2e8f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:02.690775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafc0da-01f7-41b5-8a95-d0a5ee7c2e8f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:02.694782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d9bad-0f6a-4038-a6e3-9ace7dd6d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:02.695363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9bad-0f6a-4038-a6e3-9ace7dd6d347 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:02.696218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9bad-0f6a-4038-a6e3-9ace7dd6d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:02.696507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9bad-0f6a-4038-a6e3-9ace7dd6d347 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:02.697175 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d9bad-0f6a-4038-a6e3-9ace7dd6d347 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:02.697474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d9bad-0f6a-4038-a6e3-9ace7dd6d347 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:02.722681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d9bad-0f6a-4038-a6e3-9ace7dd6d347 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:02.727972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 496/991] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Oct 27 13:59:02 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:02.733524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92979a13-1a6a-432e-bfac-a3c01fa73311 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:02.743616 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92979a13-1a6a-432e-bfac-a3c01fa73311 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:02.747718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1f551-2cee-4903-b625-c68e4a8174b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:02.748295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1f551-2cee-4903-b625-c68e4a8174b3 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:02.748587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1f551-2cee-4903-b625-c68e4a8174b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:02.748873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1f551-2cee-4903-b625-c68e4a8174b3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:02.749556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1f551-2cee-4903-b625-c68e4a8174b3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:02.774921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1f551-2cee-4903-b625-c68e4a8174b3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:02.790297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 496/992] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 13:59:02 2021] POST /identity/v3/endpoints => generated 325 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:59:04.769547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7186f-2408-4158-bf15-2758c8b732b8 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:04.770114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7186f-2408-4158-bf15-2758c8b732b8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:04.770114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7186f-2408-4158-bf15-2758c8b732b8 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:04.771833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 497/993] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:04.777370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f5f5-ea15-4f40-94cd-786dc61972e8 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:04.777756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f5f5-ea15-4f40-94cd-786dc61972e8 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:04.777928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f5f5-ea15-4f40-94cd-786dc61972e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:04.799739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8628f5f5-ea15-4f40-94cd-786dc61972e8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:04.800863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8628f5f5-ea15-4f40-94cd-786dc61972e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:04.818613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 497/994] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:04 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:04.841580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7186f-2408-4158-bf15-2758c8b732b8 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:04.853696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7186f-2408-4158-bf15-2758c8b732b8 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:04.857760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664dfc6-e943-44e0-ab7d-d5d1a96abe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:04.858479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664dfc6-e943-44e0-ab7d-d5d1a96abe6e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:04.858812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664dfc6-e943-44e0-ab7d-d5d1a96abe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:04.859099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664dfc6-e943-44e0-ab7d-d5d1a96abe6e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:04.860424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664dfc6-e943-44e0-ab7d-d5d1a96abe6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:04.886241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664dfc6-e943-44e0-ab7d-d5d1a96abe6e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:04.887760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 498/995] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:59:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:04.893840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628f5f5-ea15-4f40-94cd-786dc61972e8 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:04.903337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628f5f5-ea15-4f40-94cd-786dc61972e8 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:04.907481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a9a27-2a86-4946-8b9c-828f9105682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:04.908062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9a27-2a86-4946-8b9c-828f9105682f admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:04.908354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9a27-2a86-4946-8b9c-828f9105682f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:04.908640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9a27-2a86-4946-8b9c-828f9105682f admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:04.909286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a9a27-2a86-4946-8b9c-828f9105682f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:04.934695 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a9a27-2a86-4946-8b9c-828f9105682f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:04.962426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 498/996] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:59:04 2021] POST /identity/v3/projects => generated 311 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:59:06.978682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca7b5-9f23-4429-b0e7-a359f74f783c None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:06.979242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca7b5-9f23-4429-b0e7-a359f74f783c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:06.979242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ca7b5-9f23-4429-b0e7-a359f74f783c None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:06.980924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 499/997] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:59:06.986432 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a717ceb-6559-4e9a-b79d-6ea1654e34e3 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:06.986878 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a717ceb-6559-4e9a-b79d-6ea1654e34e3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:06.987056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a717ceb-6559-4e9a-b79d-6ea1654e34e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:07.009664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2a717ceb-6559-4e9a-b79d-6ea1654e34e3 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:07.010849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2a717ceb-6559-4e9a-b79d-6ea1654e34e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:07.073890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 499/998] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:07.097108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ca7b5-9f23-4429-b0e7-a359f74f783c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:07.109624 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ca7b5-9f23-4429-b0e7-a359f74f783c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:07.113582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add539c-91b7-4270-983e-fac3505dee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:07.114291 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add539c-91b7-4270-983e-fac3505dee2d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:07.114583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add539c-91b7-4270-983e-fac3505dee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:07.114896 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add539c-91b7-4270-983e-fac3505dee2d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:07.115954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add539c-91b7-4270-983e-fac3505dee2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:07.141941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add539c-91b7-4270-983e-fac3505dee2d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:07.143447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 500/999] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:59:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:07.149305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a717ceb-6559-4e9a-b79d-6ea1654e34e3 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:07.157983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a717ceb-6559-4e9a-b79d-6ea1654e34e3 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:07.162080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198ba2a-8285-4cfa-b01f-5edf0ea63f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:07.162762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198ba2a-8285-4cfa-b01f-5edf0ea63f86 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:07.163054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198ba2a-8285-4cfa-b01f-5edf0ea63f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:07.163336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198ba2a-8285-4cfa-b01f-5edf0ea63f86 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:07.163990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198ba2a-8285-4cfa-b01f-5edf0ea63f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:07.190505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198ba2a-8285-4cfa-b01f-5edf0ea63f86 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:07.209734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 500/1000] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:59:07 2021] POST /identity/v3/users => generated 285 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:59:09.219799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0ddd-dfe6-45a4-ace0-fe0724195e97 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:09.220374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0ddd-dfe6-45a4-ace0-fe0724195e97 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:09.220374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0ddd-dfe6-45a4-ace0-fe0724195e97 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:09.222053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 501/1001] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:09.227380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f43058-b1ce-482b-8eab-0a71129d4b47 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:09.227782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f43058-b1ce-482b-8eab-0a71129d4b47 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:09.227952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f43058-b1ce-482b-8eab-0a71129d4b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:09.250314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c3f43058-b1ce-482b-8eab-0a71129d4b47 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:09.251479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c3f43058-b1ce-482b-8eab-0a71129d4b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:09.258899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 501/1002] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:09 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:09.281122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0ddd-dfe6-45a4-ace0-fe0724195e97 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:09.292841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0ddd-dfe6-45a4-ace0-fe0724195e97 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:09.296873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e9a56-1fbc-4cb9-b52e-a8554ea9d99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:09.297583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e9a56-1fbc-4cb9-b52e-a8554ea9d99d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:09.297877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e9a56-1fbc-4cb9-b52e-a8554ea9d99d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:09.298164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e9a56-1fbc-4cb9-b52e-a8554ea9d99d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:09.310251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e9a56-1fbc-4cb9-b52e-a8554ea9d99d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:59:09.316485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-779e9a56-1fbc-4cb9-b52e-a8554ea9d99d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:59:09.317564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 502/1003] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:59:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:09.324265 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f43058-b1ce-482b-8eab-0a71129d4b47 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:09.332855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f43058-b1ce-482b-8eab-0a71129d4b47 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:09.337943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225c935-afec-404e-b7c2-7b0133c3dd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:09.338534 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225c935-afec-404e-b7c2-7b0133c3dd8d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:09.338880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225c935-afec-404e-b7c2-7b0133c3dd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:09.339175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225c935-afec-404e-b7c2-7b0133c3dd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:09.339894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225c935-afec-404e-b7c2-7b0133c3dd8d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:09.340191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225c935-afec-404e-b7c2-7b0133c3dd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:09.365290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225c935-afec-404e-b7c2-7b0133c3dd8d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:09.374379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 502/1004] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:59:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:09.380213 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e9a56-1fbc-4cb9-b52e-a8554ea9d99d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:09.390269 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e9a56-1fbc-4cb9-b52e-a8554ea9d99d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:09.394395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523850c-cdb7-4473-977c-b52e752e2ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:09.395221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523850c-cdb7-4473-977c-b52e752e2ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:09.395517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523850c-cdb7-4473-977c-b52e752e2ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:09.395805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523850c-cdb7-4473-977c-b52e752e2ec8 admin admin] PATH_INFO: `/v3/users/34e41630a13f42439de215f48822d252` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:09.414444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523850c-cdb7-4473-977c-b52e752e2ec8 admin admin] RBAC: Authorizing `identity:get_user(user_id=34e41630a13f42439de215f48822d252)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:09.440151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523850c-cdb7-4473-977c-b52e752e2ec8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:09.441675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 503/1005] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:09 2021] GET /identity/v3/users/34e41630a13f42439de215f48822d252 => generated 285 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:09.448069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225c935-afec-404e-b7c2-7b0133c3dd8d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:09.457429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225c935-afec-404e-b7c2-7b0133c3dd8d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:09.462282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12ea49-adda-4ac1-af61-cafb41195df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:09.462896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12ea49-adda-4ac1-af61-cafb41195df1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:09.463192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12ea49-adda-4ac1-af61-cafb41195df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:09.463479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12ea49-adda-4ac1-af61-cafb41195df1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:09.471104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12ea49-adda-4ac1-af61-cafb41195df1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:09.496740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12ea49-adda-4ac1-af61-cafb41195df1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:09.505258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 503/1006] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:59:09 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:59:09.511974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523850c-cdb7-4473-977c-b52e752e2ec8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:09.521080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523850c-cdb7-4473-977c-b52e752e2ec8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:09.525751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1887be-09cd-4ada-ba18-8bc09c8ec6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:09.526524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1887be-09cd-4ada-ba18-8bc09c8ec6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:09.526845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1887be-09cd-4ada-ba18-8bc09c8ec6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:09.527126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1887be-09cd-4ada-ba18-8bc09c8ec6c2 admin admin] PATH_INFO: `/v3/projects/e0184ddc4498473b9b484da1927efabb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:09.528225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1887be-09cd-4ada-ba18-8bc09c8ec6c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=e0184ddc4498473b9b484da1927efabb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:09.553577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1887be-09cd-4ada-ba18-8bc09c8ec6c2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:09.555134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 504/1007] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:09 2021] GET /identity/v3/projects/e0184ddc4498473b9b484da1927efabb => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:59:09.561309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12ea49-adda-4ac1-af61-cafb41195df1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:09.569872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12ea49-adda-4ac1-af61-cafb41195df1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:09.574570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039ecab-9d84-4c3f-8b4f-0ef274d1f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:09.575185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ecab-9d84-4c3f-8b4f-0ef274d1f8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:09.575479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ecab-9d84-4c3f-8b4f-0ef274d1f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:09.575765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ecab-9d84-4c3f-8b4f-0ef274d1f8a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:09.576536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039ecab-9d84-4c3f-8b4f-0ef274d1f8a0 admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=e0184ddc4498473b9b484da1927efabb, user.id=34e41630a13f42439de215f48822d252) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:09.576842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039ecab-9d84-4c3f-8b4f-0ef274d1f8a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:09.602664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039ecab-9d84-4c3f-8b4f-0ef274d1f8a0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:09.608483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 504/1008] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:59:09 2021] GET /identity/v3/role_assignments?user.id=34e41630a13f42439de215f48822d252&scope.project.id=e0184ddc4498473b9b484da1927efabb&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:11.607324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e0f4-e01e-43af-bd8c-a5b503397982 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:11.607885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e0f4-e01e-43af-bd8c-a5b503397982 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:11.607885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e0f4-e01e-43af-bd8c-a5b503397982 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:11.609813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 505/1009] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:11.615142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88854-6989-49df-95ea-7bded0a8c516 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:11.615595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88854-6989-49df-95ea-7bded0a8c516 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:11.615723 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88854-6989-49df-95ea-7bded0a8c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:11.639005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-75b88854-6989-49df-95ea-7bded0a8c516 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:11.640860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-75b88854-6989-49df-95ea-7bded0a8c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:11.650214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 505/1010] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:11 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:11.675399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e0f4-e01e-43af-bd8c-a5b503397982 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:11.687781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e0f4-e01e-43af-bd8c-a5b503397982 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:11.691854 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d0134-3b74-44db-8bb6-79a4957e8ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:11.692566 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d0134-3b74-44db-8bb6-79a4957e8ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:11.692857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d0134-3b74-44db-8bb6-79a4957e8ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:11.693141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d0134-3b74-44db-8bb6-79a4957e8ae9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:11.704367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d0134-3b74-44db-8bb6-79a4957e8ae9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:59:11.710689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-016d0134-3b74-44db-8bb6-79a4957e8ae9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:59:11.711831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 506/1011] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:59:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:11.717920 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88854-6989-49df-95ea-7bded0a8c516 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:11.727100 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88854-6989-49df-95ea-7bded0a8c516 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:11.731282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0d570-c6b2-48c7-be73-82b5264272f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:11.731877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0d570-c6b2-48c7-be73-82b5264272f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:11.732169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0d570-c6b2-48c7-be73-82b5264272f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:11.732454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0d570-c6b2-48c7-be73-82b5264272f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:11.733168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0d570-c6b2-48c7-be73-82b5264272f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:11.733469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0d570-c6b2-48c7-be73-82b5264272f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:11.759199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0d570-c6b2-48c7-be73-82b5264272f8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:11.767739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 506/1012] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:59:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:11.773502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d0134-3b74-44db-8bb6-79a4957e8ae9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:11.784908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d0134-3b74-44db-8bb6-79a4957e8ae9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:11.789552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b62859-43d9-468b-8713-aad996dd3f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:11.790391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b62859-43d9-468b-8713-aad996dd3f8d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:11.790726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b62859-43d9-468b-8713-aad996dd3f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:11.791011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b62859-43d9-468b-8713-aad996dd3f8d admin admin] PATH_INFO: `/v3/users/34e41630a13f42439de215f48822d252` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:11.792201 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b62859-43d9-468b-8713-aad996dd3f8d admin admin] RBAC: Authorizing `identity:get_user(user_id=34e41630a13f42439de215f48822d252)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:11.818207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b62859-43d9-468b-8713-aad996dd3f8d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:11.819762 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 507/1013] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:11 2021] GET /identity/v3/users/34e41630a13f42439de215f48822d252 => generated 285 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:11.825533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0d570-c6b2-48c7-be73-82b5264272f8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:11.835097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0d570-c6b2-48c7-be73-82b5264272f8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:11.839423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503543fb-242e-4c42-8e0b-22bb3be2449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:11.840213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503543fb-242e-4c42-8e0b-22bb3be2449d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:11.840507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503543fb-242e-4c42-8e0b-22bb3be2449d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:11.840796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503543fb-242e-4c42-8e0b-22bb3be2449d admin admin] PATH_INFO: `/v3/projects/e0184ddc4498473b9b484da1927efabb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:11.842010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503543fb-242e-4c42-8e0b-22bb3be2449d admin admin] RBAC: Authorizing `identity:get_project(project_id=e0184ddc4498473b9b484da1927efabb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:11.868928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503543fb-242e-4c42-8e0b-22bb3be2449d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:11.870455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 507/1014] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:11 2021] GET /identity/v3/projects/e0184ddc4498473b9b484da1927efabb => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:11.876363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b62859-43d9-468b-8713-aad996dd3f8d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:11.885939 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b62859-43d9-468b-8713-aad996dd3f8d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:11.890007 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc6adc-f6e4-4eaa-893d-9df9cd10d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:11.890845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc6adc-f6e4-4eaa-893d-9df9cd10d3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:11.891135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc6adc-f6e4-4eaa-893d-9df9cd10d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:11.891421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc6adc-f6e4-4eaa-893d-9df9cd10d3cd admin admin] PATH_INFO: `/v3/projects/e0184ddc4498473b9b484da1927efabb/users/34e41630a13f42439de215f48822d252/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:11.893153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc6adc-f6e4-4eaa-893d-9df9cd10d3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0184ddc4498473b9b484da1927efabb, user_id=34e41630a13f42439de215f48822d252, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:11.921393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc6adc-f6e4-4eaa-893d-9df9cd10d3cd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:11.934985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 508/1015] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:59:11 2021] PUT /identity/v3/projects/e0184ddc4498473b9b484da1927efabb/users/34e41630a13f42439de215f48822d252/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:59:13.905416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded05a-690e-44bf-b86e-8b3e783b4a74 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:13.905984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded05a-690e-44bf-b86e-8b3e783b4a74 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:13.905984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded05a-690e-44bf-b86e-8b3e783b4a74 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:13.907674 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 508/1016] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:13.913023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae251fd-a481-40d4-9520-553caf194d2c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:13.913434 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae251fd-a481-40d4-9520-553caf194d2c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:13.913603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae251fd-a481-40d4-9520-553caf194d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:13.936084 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-dae251fd-a481-40d4-9520-553caf194d2c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:13.937226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-dae251fd-a481-40d4-9520-553caf194d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:14.001700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 509/1017] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:14.027733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded05a-690e-44bf-b86e-8b3e783b4a74 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:14.039708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded05a-690e-44bf-b86e-8b3e783b4a74 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:14.043674 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536dda6-7646-4709-9d30-f6c47feba399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:14.044394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536dda6-7646-4709-9d30-f6c47feba399 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:14.044690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536dda6-7646-4709-9d30-f6c47feba399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:14.044975 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536dda6-7646-4709-9d30-f6c47feba399 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:14.057057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536dda6-7646-4709-9d30-f6c47feba399 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:59:14.063342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-0536dda6-7646-4709-9d30-f6c47feba399 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:59:14.064422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 509/1018] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:59:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 13:59:14.070922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae251fd-a481-40d4-9520-553caf194d2c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:14.079547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae251fd-a481-40d4-9520-553caf194d2c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:14.083649 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283d56f-cf86-4ba7-8c69-d1a50f67b230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:14.084239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283d56f-cf86-4ba7-8c69-d1a50f67b230 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:14.084539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283d56f-cf86-4ba7-8c69-d1a50f67b230 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:14.084822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283d56f-cf86-4ba7-8c69-d1a50f67b230 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:14.085531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283d56f-cf86-4ba7-8c69-d1a50f67b230 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:14.086428 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283d56f-cf86-4ba7-8c69-d1a50f67b230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:14.112100 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283d56f-cf86-4ba7-8c69-d1a50f67b230 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:14.121229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 510/1019] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:59:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:14.126913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536dda6-7646-4709-9d30-f6c47feba399 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:14.136713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536dda6-7646-4709-9d30-f6c47feba399 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:14.140815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc268e-2ca6-4d0e-bf24-4d19ff96ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:14.141601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc268e-2ca6-4d0e-bf24-4d19ff96ae7c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:14.141891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc268e-2ca6-4d0e-bf24-4d19ff96ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:14.142174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc268e-2ca6-4d0e-bf24-4d19ff96ae7c admin admin] PATH_INFO: `/v3/users/34e41630a13f42439de215f48822d252` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:14.143278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc268e-2ca6-4d0e-bf24-4d19ff96ae7c admin admin] RBAC: Authorizing `identity:get_user(user_id=34e41630a13f42439de215f48822d252)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:14.169068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc268e-2ca6-4d0e-bf24-4d19ff96ae7c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:14.170466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 510/1020] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:14 2021] GET /identity/v3/users/34e41630a13f42439de215f48822d252 => generated 285 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:14.175936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283d56f-cf86-4ba7-8c69-d1a50f67b230 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:14.185673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283d56f-cf86-4ba7-8c69-d1a50f67b230 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:14.189804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d5991-7b72-4288-924a-bcc771a7331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:14.190371 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d5991-7b72-4288-924a-bcc771a7331b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:14.190697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d5991-7b72-4288-924a-bcc771a7331b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:14.190988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d5991-7b72-4288-924a-bcc771a7331b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:14.199108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d5991-7b72-4288-924a-bcc771a7331b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:14.224414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d5991-7b72-4288-924a-bcc771a7331b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:14.233139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 511/1021] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:59:14 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:59:14.239198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc268e-2ca6-4d0e-bf24-4d19ff96ae7c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:14.248996 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc268e-2ca6-4d0e-bf24-4d19ff96ae7c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:14.253131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c80b8-5b8d-43e9-a2eb-66073b1883b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:14.253908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c80b8-5b8d-43e9-a2eb-66073b1883b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:14.254196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c80b8-5b8d-43e9-a2eb-66073b1883b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:14.254486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c80b8-5b8d-43e9-a2eb-66073b1883b3 admin admin] PATH_INFO: `/v3/projects/e0184ddc4498473b9b484da1927efabb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:14.255589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c80b8-5b8d-43e9-a2eb-66073b1883b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=e0184ddc4498473b9b484da1927efabb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:14.281571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c80b8-5b8d-43e9-a2eb-66073b1883b3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:14.283109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 511/1022] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:14 2021] GET /identity/v3/projects/e0184ddc4498473b9b484da1927efabb => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:14.289065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d5991-7b72-4288-924a-bcc771a7331b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:14.297632 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d5991-7b72-4288-924a-bcc771a7331b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:14.301832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9098d-82e3-4617-9339-0ea162f44efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:14.302410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9098d-82e3-4617-9339-0ea162f44efb admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:14.302738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9098d-82e3-4617-9339-0ea162f44efb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:14.303027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9098d-82e3-4617-9339-0ea162f44efb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:14.303800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9098d-82e3-4617-9339-0ea162f44efb admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=e0184ddc4498473b9b484da1927efabb, user.id=34e41630a13f42439de215f48822d252) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:14.304110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9098d-82e3-4617-9339-0ea162f44efb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:14.332768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9098d-82e3-4617-9339-0ea162f44efb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:14.339268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 512/1023] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:59:14 2021] GET /identity/v3/role_assignments?user.id=34e41630a13f42439de215f48822d252&scope.project.id=e0184ddc4498473b9b484da1927efabb&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:16.305191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bd7f4-15d0-46b1-8ea7-d81ba6032182 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:16.305707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bd7f4-15d0-46b1-8ea7-d81ba6032182 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:16.305707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bd7f4-15d0-46b1-8ea7-d81ba6032182 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:16.307370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 512/1024] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:16.312410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988829-9bc2-4619-aa59-f42727eceda6 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:16.312851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988829-9bc2-4619-aa59-f42727eceda6 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:16.312997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988829-9bc2-4619-aa59-f42727eceda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:16.337006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-d5988829-9bc2-4619-aa59-f42727eceda6 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:16.338141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d5988829-9bc2-4619-aa59-f42727eceda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:16.344932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 513/1025] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:16.368476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bd7f4-15d0-46b1-8ea7-d81ba6032182 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:16.380295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bd7f4-15d0-46b1-8ea7-d81ba6032182 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:16.385098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10debedc-5076-44fb-9c1d-99b9a86b2056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:16.385806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10debedc-5076-44fb-9c1d-99b9a86b2056 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:16.386095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10debedc-5076-44fb-9c1d-99b9a86b2056 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:16.386433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10debedc-5076-44fb-9c1d-99b9a86b2056 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:16.387531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10debedc-5076-44fb-9c1d-99b9a86b2056 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:16.413321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10debedc-5076-44fb-9c1d-99b9a86b2056 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:16.415044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 513/1026] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:59:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:16.420745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5988829-9bc2-4619-aa59-f42727eceda6 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:16.429273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5988829-9bc2-4619-aa59-f42727eceda6 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:16.433965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a2be6-5463-46d8-a99f-89ae871e0477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:16.434554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a2be6-5463-46d8-a99f-89ae871e0477 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:16.434872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a2be6-5463-46d8-a99f-89ae871e0477 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:16.435154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a2be6-5463-46d8-a99f-89ae871e0477 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:16.435799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a2be6-5463-46d8-a99f-89ae871e0477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:16.461868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a2be6-5463-46d8-a99f-89ae871e0477 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:16.481748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 514/1027] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:59:16 2021] POST /identity/v3/users => generated 286 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:59:18.472028 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31817389-4c0b-428f-a497-5958fb48fd3e None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:18.472598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31817389-4c0b-428f-a497-5958fb48fd3e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:18.472598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31817389-4c0b-428f-a497-5958fb48fd3e None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:18.474230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 514/1028] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:18.479950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92814e41-cdda-4390-b8e4-9d38b884ebf0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:18.480365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92814e41-cdda-4390-b8e4-9d38b884ebf0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:18.480519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92814e41-cdda-4390-b8e4-9d38b884ebf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:18.503423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-92814e41-cdda-4390-b8e4-9d38b884ebf0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:18.504558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-92814e41-cdda-4390-b8e4-9d38b884ebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:18.511370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 515/1029] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:18 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:18.533319 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31817389-4c0b-428f-a497-5958fb48fd3e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:18.545416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31817389-4c0b-428f-a497-5958fb48fd3e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:18.549352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdf0c2-085f-4930-885a-4f9fe032e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:18.550128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdf0c2-085f-4930-885a-4f9fe032e502 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:18.550416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdf0c2-085f-4930-885a-4f9fe032e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:18.550733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdf0c2-085f-4930-885a-4f9fe032e502 admin admin] PATH_INFO: `/v3/roles/886f966104ce425fa75dbe7ee88aba33` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:18.552044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdf0c2-085f-4930-885a-4f9fe032e502 admin admin] RBAC: Authorizing `identity:get_role(role_id=886f966104ce425fa75dbe7ee88aba33)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:18.576977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-d9fdf0c2-085f-4930-885a-4f9fe032e502 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:59:18.576977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:59:18.576977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:59:18.577846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdf0c2-085f-4930-885a-4f9fe032e502 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:18.579124 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 515/1030] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:18 2021] GET /identity/v3/roles/886f966104ce425fa75dbe7ee88aba33 => generated 223 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:18.585916 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92814e41-cdda-4390-b8e4-9d38b884ebf0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:18.594745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92814e41-cdda-4390-b8e4-9d38b884ebf0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:18.598842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b37b9-c833-4091-8309-c93e26e90567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:18.599629 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b37b9-c833-4091-8309-c93e26e90567 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:18.599923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b37b9-c833-4091-8309-c93e26e90567 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:18.600207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b37b9-c833-4091-8309-c93e26e90567 admin admin] PATH_INFO: `/v3/users/1412d29489344a34868d7b99c0f27ad3` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:18.621024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b37b9-c833-4091-8309-c93e26e90567 admin admin] RBAC: Authorizing `identity:get_user(user_id=1412d29489344a34868d7b99c0f27ad3)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:18.646768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b37b9-c833-4091-8309-c93e26e90567 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:18.648834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 516/1031] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:18 2021] GET /identity/v3/users/1412d29489344a34868d7b99c0f27ad3 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:18.654631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdf0c2-085f-4930-885a-4f9fe032e502 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:18.664519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdf0c2-085f-4930-885a-4f9fe032e502 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:18.668711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62157f-8ab0-4fc6-a214-31cada0c63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:18.669283 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62157f-8ab0-4fc6-a214-31cada0c63e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:18.669573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62157f-8ab0-4fc6-a214-31cada0c63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:18.669857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62157f-8ab0-4fc6-a214-31cada0c63e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:18.677412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62157f-8ab0-4fc6-a214-31cada0c63e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:18.702843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62157f-8ab0-4fc6-a214-31cada0c63e3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:18.712119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 516/1032] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:59:18 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:59:18.718044 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b37b9-c833-4091-8309-c93e26e90567 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:18.728067 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b37b9-c833-4091-8309-c93e26e90567 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:18.732051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6fef2-4fea-4385-acd2-45bbecefe262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:18.732825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fef2-4fea-4385-acd2-45bbecefe262 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:18.733116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fef2-4fea-4385-acd2-45bbecefe262 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:18.733401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6fef2-4fea-4385-acd2-45bbecefe262 admin admin] PATH_INFO: `/v3/projects/e0184ddc4498473b9b484da1927efabb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:18.734766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6fef2-4fea-4385-acd2-45bbecefe262 admin admin] RBAC: Authorizing `identity:get_project(project_id=e0184ddc4498473b9b484da1927efabb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:18.760416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6fef2-4fea-4385-acd2-45bbecefe262 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:18.761947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 517/1033] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:18 2021] GET /identity/v3/projects/e0184ddc4498473b9b484da1927efabb => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:18.767973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62157f-8ab0-4fc6-a214-31cada0c63e3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:18.777260 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62157f-8ab0-4fc6-a214-31cada0c63e3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:18.781407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe96332-f917-4f6b-8e9e-a173392b2d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:18.781983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe96332-f917-4f6b-8e9e-a173392b2d65 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:18.782272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe96332-f917-4f6b-8e9e-a173392b2d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:18.782555 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe96332-f917-4f6b-8e9e-a173392b2d65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:18.783353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe96332-f917-4f6b-8e9e-a173392b2d65 admin admin] RBAC: Adding query filter params (role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=e0184ddc4498473b9b484da1927efabb, user.id=1412d29489344a34868d7b99c0f27ad3) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:18.783660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe96332-f917-4f6b-8e9e-a173392b2d65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:18.809563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe96332-f917-4f6b-8e9e-a173392b2d65 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:18.815253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 517/1034] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:59:18 2021] GET /identity/v3/role_assignments?user.id=1412d29489344a34868d7b99c0f27ad3&scope.project.id=e0184ddc4498473b9b484da1927efabb&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:59:20.855701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c4fc7-3001-4f74-9063-8e8c5a4ec2eb None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:20.856237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c4fc7-3001-4f74-9063-8e8c5a4ec2eb None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:20.856237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c4fc7-3001-4f74-9063-8e8c5a4ec2eb None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:20.858040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 518/1035] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:59:20.863967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80276c93-41fc-4349-b812-b380155604f4 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:20.864463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80276c93-41fc-4349-b812-b380155604f4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:20.864613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80276c93-41fc-4349-b812-b380155604f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:20.890363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-80276c93-41fc-4349-b812-b380155604f4 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:20.892248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-80276c93-41fc-4349-b812-b380155604f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:20.899249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 518/1036] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:20 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:20.920898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c4fc7-3001-4f74-9063-8e8c5a4ec2eb None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:20.933214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c4fc7-3001-4f74-9063-8e8c5a4ec2eb None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:20.937280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb6c3f-6e30-4eb2-a5b9-e66a05e0b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:20.938058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb6c3f-6e30-4eb2-a5b9-e66a05e0b1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:20.938352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb6c3f-6e30-4eb2-a5b9-e66a05e0b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:20.938666 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb6c3f-6e30-4eb2-a5b9-e66a05e0b1b3 admin admin] PATH_INFO: `/v3/roles/886f966104ce425fa75dbe7ee88aba33` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:20.940012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb6c3f-6e30-4eb2-a5b9-e66a05e0b1b3 admin admin] RBAC: Authorizing `identity:get_role(role_id=886f966104ce425fa75dbe7ee88aba33)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:20.965317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-50bb6c3f-6e30-4eb2-a5b9-e66a05e0b1b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:59:20.965317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 13:59:20.965317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 13:59:20.966194 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb6c3f-6e30-4eb2-a5b9-e66a05e0b1b3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:20.967574 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 519/1037] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:20 2021] GET /identity/v3/roles/886f966104ce425fa75dbe7ee88aba33 => generated 223 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:20.973487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80276c93-41fc-4349-b812-b380155604f4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:20.982801 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80276c93-41fc-4349-b812-b380155604f4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:20.987179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a682de3-1c3c-45e6-bacb-a2689f63abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:20.987978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682de3-1c3c-45e6-bacb-a2689f63abe5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:20.988268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682de3-1c3c-45e6-bacb-a2689f63abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:20.988555 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682de3-1c3c-45e6-bacb-a2689f63abe5 admin admin] PATH_INFO: `/v3/users/1412d29489344a34868d7b99c0f27ad3` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:20.989650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a682de3-1c3c-45e6-bacb-a2689f63abe5 admin admin] RBAC: Authorizing `identity:get_user(user_id=1412d29489344a34868d7b99c0f27ad3)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:21.016435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a682de3-1c3c-45e6-bacb-a2689f63abe5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:21.017960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 519/1038] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:20 2021] GET /identity/v3/users/1412d29489344a34868d7b99c0f27ad3 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:21.024121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb6c3f-6e30-4eb2-a5b9-e66a05e0b1b3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:21.033475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb6c3f-6e30-4eb2-a5b9-e66a05e0b1b3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:21.037552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b9438-72dc-464a-a1ea-bca9a6eb2d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:21.038325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9438-72dc-464a-a1ea-bca9a6eb2d26 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:21.038658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9438-72dc-464a-a1ea-bca9a6eb2d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:21.038951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9438-72dc-464a-a1ea-bca9a6eb2d26 admin admin] PATH_INFO: `/v3/projects/e0184ddc4498473b9b484da1927efabb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:21.040085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b9438-72dc-464a-a1ea-bca9a6eb2d26 admin admin] RBAC: Authorizing `identity:get_project(project_id=e0184ddc4498473b9b484da1927efabb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:21.066756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b9438-72dc-464a-a1ea-bca9a6eb2d26 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:21.068322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 520/1039] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:21 2021] GET /identity/v3/projects/e0184ddc4498473b9b484da1927efabb => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:21.074964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a682de3-1c3c-45e6-bacb-a2689f63abe5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:21.084397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a682de3-1c3c-45e6-bacb-a2689f63abe5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:21.089237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958df9e9-1fbb-454f-9234-064f9a35ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:21.090061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958df9e9-1fbb-454f-9234-064f9a35ba7c admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:21.090357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958df9e9-1fbb-454f-9234-064f9a35ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:21.090673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958df9e9-1fbb-454f-9234-064f9a35ba7c admin admin] PATH_INFO: `/v3/projects/e0184ddc4498473b9b484da1927efabb/users/1412d29489344a34868d7b99c0f27ad3/roles/886f966104ce425fa75dbe7ee88aba33` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:21.092615 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958df9e9-1fbb-454f-9234-064f9a35ba7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0184ddc4498473b9b484da1927efabb, user_id=1412d29489344a34868d7b99c0f27ad3, role_id=886f966104ce425fa75dbe7ee88aba33)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:21.119877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958df9e9-1fbb-454f-9234-064f9a35ba7c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:21.132954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 520/1040] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:59:21 2021] PUT /identity/v3/projects/e0184ddc4498473b9b484da1927efabb/users/1412d29489344a34868d7b99c0f27ad3/roles/886f966104ce425fa75dbe7ee88aba33 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:59:23.109407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b7f2-e8ba-4ada-9136-dfc32032771f None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:23.109931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b7f2-e8ba-4ada-9136-dfc32032771f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:23.110101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b7f2-e8ba-4ada-9136-dfc32032771f None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:23.111735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 521/1041] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:23.117494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3a65-b62d-40bd-84de-e96825d20318 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:23.117899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3a65-b62d-40bd-84de-e96825d20318 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:23.118070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3a65-b62d-40bd-84de-e96825d20318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:23.141890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-99db3a65-b62d-40bd-84de-e96825d20318 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:23.143056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-99db3a65-b62d-40bd-84de-e96825d20318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:23.205681 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 521/1042] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:23 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:23.227793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b7f2-e8ba-4ada-9136-dfc32032771f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:23.239844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b7f2-e8ba-4ada-9136-dfc32032771f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:23.244334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869506d-31d2-4a87-9af8-36c00185e8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:23.245107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869506d-31d2-4a87-9af8-36c00185e8cc admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:23.245400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869506d-31d2-4a87-9af8-36c00185e8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:23.245685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869506d-31d2-4a87-9af8-36c00185e8cc admin admin] PATH_INFO: `/v3/roles/886f966104ce425fa75dbe7ee88aba33` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:23.247031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869506d-31d2-4a87-9af8-36c00185e8cc admin admin] RBAC: Authorizing `identity:get_role(role_id=886f966104ce425fa75dbe7ee88aba33)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:23.272967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869506d-31d2-4a87-9af8-36c00185e8cc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:23.274112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 522/1043] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:23 2021] GET /identity/v3/roles/886f966104ce425fa75dbe7ee88aba33 => generated 223 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:23.279800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3a65-b62d-40bd-84de-e96825d20318 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:23.288313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3a65-b62d-40bd-84de-e96825d20318 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:23.292545 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499175b-ec19-4077-982d-acf21420c6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:23.293325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499175b-ec19-4077-982d-acf21420c6ef admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:23.293609 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499175b-ec19-4077-982d-acf21420c6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:23.293886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499175b-ec19-4077-982d-acf21420c6ef admin admin] PATH_INFO: `/v3/users/1412d29489344a34868d7b99c0f27ad3` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:23.294984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499175b-ec19-4077-982d-acf21420c6ef admin admin] RBAC: Authorizing `identity:get_user(user_id=1412d29489344a34868d7b99c0f27ad3)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:23.321142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499175b-ec19-4077-982d-acf21420c6ef admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:23.322592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 522/1044] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:23 2021] GET /identity/v3/users/1412d29489344a34868d7b99c0f27ad3 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:23.328251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869506d-31d2-4a87-9af8-36c00185e8cc admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:23.337732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869506d-31d2-4a87-9af8-36c00185e8cc admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:23.342441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad82fb-332f-4a40-b467-1e3322ec44a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:23.343053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad82fb-332f-4a40-b467-1e3322ec44a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:23.343349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad82fb-332f-4a40-b467-1e3322ec44a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:23.343637 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad82fb-332f-4a40-b467-1e3322ec44a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:23.351586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad82fb-332f-4a40-b467-1e3322ec44a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:23.377571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad82fb-332f-4a40-b467-1e3322ec44a3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:23.387150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 523/1045] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:59:23 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:59:23.393094 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499175b-ec19-4077-982d-acf21420c6ef admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:23.402523 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499175b-ec19-4077-982d-acf21420c6ef admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:23.406562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527ca7a-b946-47a8-aa64-6982d79e9872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:23.407354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527ca7a-b946-47a8-aa64-6982d79e9872 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:23.407639 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527ca7a-b946-47a8-aa64-6982d79e9872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:23.407917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527ca7a-b946-47a8-aa64-6982d79e9872 admin admin] PATH_INFO: `/v3/projects/e0184ddc4498473b9b484da1927efabb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:23.408978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527ca7a-b946-47a8-aa64-6982d79e9872 admin admin] RBAC: Authorizing `identity:get_project(project_id=e0184ddc4498473b9b484da1927efabb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:23.434689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527ca7a-b946-47a8-aa64-6982d79e9872 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:23.436205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 523/1046] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:23 2021] GET /identity/v3/projects/e0184ddc4498473b9b484da1927efabb => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:23.442094 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad82fb-332f-4a40-b467-1e3322ec44a3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:23.451618 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad82fb-332f-4a40-b467-1e3322ec44a3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:23.455799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb30d-2522-4899-848a-b70898ce6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:23.456374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb30d-2522-4899-848a-b70898ce6519 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:23.456666 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb30d-2522-4899-848a-b70898ce6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:23.456975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb30d-2522-4899-848a-b70898ce6519 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:23.457746 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb30d-2522-4899-848a-b70898ce6519 admin admin] RBAC: Adding query filter params (role.id=886f966104ce425fa75dbe7ee88aba33, scope.project.id=e0184ddc4498473b9b484da1927efabb, user.id=1412d29489344a34868d7b99c0f27ad3) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:23.458051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb30d-2522-4899-848a-b70898ce6519 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:23.484514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb30d-2522-4899-848a-b70898ce6519 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:23.490395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 524/1047] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:59:23 2021] GET /identity/v3/role_assignments?user.id=1412d29489344a34868d7b99c0f27ad3&scope.project.id=e0184ddc4498473b9b484da1927efabb&role.id=886f966104ce425fa75dbe7ee88aba33 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:25.449063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e60310-e965-4287-9ab1-354cbb492a90 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:25.449598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e60310-e965-4287-9ab1-354cbb492a90 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:25.449711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e60310-e965-4287-9ab1-354cbb492a90 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:25.451327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 524/1048] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:25.456330 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb427e4-29b1-4c9d-bbdd-fe2d1599cc1b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:25.456730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb427e4-29b1-4c9d-bbdd-fe2d1599cc1b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:25.456899 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb427e4-29b1-4c9d-bbdd-fe2d1599cc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:25.480634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-fdb427e4-29b1-4c9d-bbdd-fe2d1599cc1b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:25.481947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fdb427e4-29b1-4c9d-bbdd-fe2d1599cc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:25.490087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 525/1049] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:25 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:25.512397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e60310-e965-4287-9ab1-354cbb492a90 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:25.524526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e60310-e965-4287-9ab1-354cbb492a90 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:25.528485 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e01e4-11c8-4c4b-81b4-f7d75311e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:25.529198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e01e4-11c8-4c4b-81b4-f7d75311e31a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:25.529490 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e01e4-11c8-4c4b-81b4-f7d75311e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:25.529770 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e01e4-11c8-4c4b-81b4-f7d75311e31a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:25.530874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e01e4-11c8-4c4b-81b4-f7d75311e31a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:25.556485 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e01e4-11c8-4c4b-81b4-f7d75311e31a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:25.558032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 525/1050] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:59:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:25.563927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb427e4-29b1-4c9d-bbdd-fe2d1599cc1b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:25.572842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb427e4-29b1-4c9d-bbdd-fe2d1599cc1b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:25.576955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d88b9c-ae0e-46ee-af38-274fc0555269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:25.577547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d88b9c-ae0e-46ee-af38-274fc0555269 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:25.577837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d88b9c-ae0e-46ee-af38-274fc0555269 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:25.578117 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d88b9c-ae0e-46ee-af38-274fc0555269 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:25.578813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d88b9c-ae0e-46ee-af38-274fc0555269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:25.605541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d88b9c-ae0e-46ee-af38-274fc0555269 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:25.633451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 526/1051] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:59:25 2021] POST /identity/v3/projects => generated 311 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:59:27.681720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6040aa-16b3-4289-90f5-dcf13fa3a5a0 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:27.682278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6040aa-16b3-4289-90f5-dcf13fa3a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:27.682278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6040aa-16b3-4289-90f5-dcf13fa3a5a0 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:27.683964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 526/1052] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:27.689125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d8b6d-c402-416f-a82c-5d8812e8fec2 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:27.689524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d8b6d-c402-416f-a82c-5d8812e8fec2 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:27.689699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d8b6d-c402-416f-a82c-5d8812e8fec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:27.712241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-098d8b6d-c402-416f-a82c-5d8812e8fec2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:27.713381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-098d8b6d-c402-416f-a82c-5d8812e8fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:27.777985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 527/1053] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:27 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:27.801287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6040aa-16b3-4289-90f5-dcf13fa3a5a0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:27.814033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6040aa-16b3-4289-90f5-dcf13fa3a5a0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:27.817993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e55f3-85b9-4fcb-b44a-7ecf7095f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:27.818738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e55f3-85b9-4fcb-b44a-7ecf7095f54a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:27.819032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e55f3-85b9-4fcb-b44a-7ecf7095f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:27.819311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e55f3-85b9-4fcb-b44a-7ecf7095f54a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:27.821250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e55f3-85b9-4fcb-b44a-7ecf7095f54a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:27.846195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e55f3-85b9-4fcb-b44a-7ecf7095f54a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:27.847723 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 527/1054] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 13:59:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:27.853843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d8b6d-c402-416f-a82c-5d8812e8fec2 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:27.862920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d8b6d-c402-416f-a82c-5d8812e8fec2 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:27.867760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129767a-3131-4889-88ba-210cf37e6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:27.868354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129767a-3131-4889-88ba-210cf37e6b43 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:27.868651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129767a-3131-4889-88ba-210cf37e6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:27.868938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129767a-3131-4889-88ba-210cf37e6b43 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:27.869600 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129767a-3131-4889-88ba-210cf37e6b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:27.895659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129767a-3131-4889-88ba-210cf37e6b43 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:27.915612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 528/1055] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:59:27 2021] POST /identity/v3/users => generated 286 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:59:29.915436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4671-daae-4735-9cd6-85b787aa5dbe None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:29.915972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4671-daae-4735-9cd6-85b787aa5dbe None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:29.916063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4671-daae-4735-9cd6-85b787aa5dbe None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:29.917662 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 528/1056] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:29.922956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24373f-569f-4ea8-a8f9-368b00754829 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:29.923390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24373f-569f-4ea8-a8f9-368b00754829 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:29.923524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24373f-569f-4ea8-a8f9-368b00754829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:29.947618 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-2e24373f-569f-4ea8-a8f9-368b00754829 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:29.948832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2e24373f-569f-4ea8-a8f9-368b00754829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:29.955665 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 529/1057] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:29 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:29.979096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4671-daae-4735-9cd6-85b787aa5dbe None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:29.991204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4671-daae-4735-9cd6-85b787aa5dbe None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:29.995516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388fddf-e941-4a96-a6f2-b766297056dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:29.996237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388fddf-e941-4a96-a6f2-b766297056dd admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:29.996531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388fddf-e941-4a96-a6f2-b766297056dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:29.996851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388fddf-e941-4a96-a6f2-b766297056dd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:30.008973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388fddf-e941-4a96-a6f2-b766297056dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:59:30.015146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e388fddf-e941-4a96-a6f2-b766297056dd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:59:30.016250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 529/1058] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:59:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:30.022288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24373f-569f-4ea8-a8f9-368b00754829 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:30.031474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24373f-569f-4ea8-a8f9-368b00754829 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:30.035483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495491d7-a9a4-4189-850d-61a68c2a190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:30.036074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495491d7-a9a4-4189-850d-61a68c2a190d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:30.036360 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495491d7-a9a4-4189-850d-61a68c2a190d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:30.036637 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495491d7-a9a4-4189-850d-61a68c2a190d admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:30.037332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495491d7-a9a4-4189-850d-61a68c2a190d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:30.037629 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495491d7-a9a4-4189-850d-61a68c2a190d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:30.062914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495491d7-a9a4-4189-850d-61a68c2a190d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:30.071421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 530/1059] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:59:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:30.077097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388fddf-e941-4a96-a6f2-b766297056dd admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:30.087026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388fddf-e941-4a96-a6f2-b766297056dd admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:30.091115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c9604-390b-4228-965d-6c578ebc0fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:30.091900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c9604-390b-4228-965d-6c578ebc0fcf admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:30.092190 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c9604-390b-4228-965d-6c578ebc0fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:30.092474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c9604-390b-4228-965d-6c578ebc0fcf admin admin] PATH_INFO: `/v3/users/56ed375dbd0f4d2493faa9d3c5695dab` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:30.111361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c9604-390b-4228-965d-6c578ebc0fcf admin admin] RBAC: Authorizing `identity:get_user(user_id=56ed375dbd0f4d2493faa9d3c5695dab)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:30.136936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c9604-390b-4228-965d-6c578ebc0fcf admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:30.138425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 530/1060] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:30 2021] GET /identity/v3/users/56ed375dbd0f4d2493faa9d3c5695dab => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:30.144104 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495491d7-a9a4-4189-850d-61a68c2a190d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:30.153979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495491d7-a9a4-4189-850d-61a68c2a190d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:30.158027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d3a87-15e2-445f-ab7f-aa9943798705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:30.158590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3a87-15e2-445f-ab7f-aa9943798705 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:30.158910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3a87-15e2-445f-ab7f-aa9943798705 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:30.159189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3a87-15e2-445f-ab7f-aa9943798705 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:30.167515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d3a87-15e2-445f-ab7f-aa9943798705 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:30.192330 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d3a87-15e2-445f-ab7f-aa9943798705 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:30.201211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 531/1061] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:59:30 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:59:30.207228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c9604-390b-4228-965d-6c578ebc0fcf admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:30.217060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c9604-390b-4228-965d-6c578ebc0fcf admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:30.221156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101dedf-36e0-4ff9-80d3-4c344affda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:30.221935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101dedf-36e0-4ff9-80d3-4c344affda03 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:30.222228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101dedf-36e0-4ff9-80d3-4c344affda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:30.222516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101dedf-36e0-4ff9-80d3-4c344affda03 admin admin] PATH_INFO: `/v3/projects/1e80d98f09924acdb64835c3e7c3f14a` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:30.223636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101dedf-36e0-4ff9-80d3-4c344affda03 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e80d98f09924acdb64835c3e7c3f14a)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:30.249894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101dedf-36e0-4ff9-80d3-4c344affda03 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:30.251464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 531/1062] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:30 2021] GET /identity/v3/projects/1e80d98f09924acdb64835c3e7c3f14a => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:30.257965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d3a87-15e2-445f-ab7f-aa9943798705 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:30.266738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d3a87-15e2-445f-ab7f-aa9943798705 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:30.270840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0c6fc-6868-401a-82fc-9871275f1610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:30.271413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0c6fc-6868-401a-82fc-9871275f1610 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:30.271702 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0c6fc-6868-401a-82fc-9871275f1610 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:30.271982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0c6fc-6868-401a-82fc-9871275f1610 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:30.273441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0c6fc-6868-401a-82fc-9871275f1610 admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=1e80d98f09924acdb64835c3e7c3f14a, user.id=56ed375dbd0f4d2493faa9d3c5695dab) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:30.273774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0c6fc-6868-401a-82fc-9871275f1610 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:30.299572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0c6fc-6868-401a-82fc-9871275f1610 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:30.305106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 532/1063] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:59:30 2021] GET /identity/v3/role_assignments?user.id=56ed375dbd0f4d2493faa9d3c5695dab&scope.project.id=1e80d98f09924acdb64835c3e7c3f14a&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:32.258722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0b99f-254c-4087-bc76-8528634e3594 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:32.259221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0b99f-254c-4087-bc76-8528634e3594 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:32.259221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0b99f-254c-4087-bc76-8528634e3594 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:32.260908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 532/1064] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:32.266087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c735ae-3186-41f2-8886-ef13facfd67e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:32.266507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c735ae-3186-41f2-8886-ef13facfd67e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:32.266681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c735ae-3186-41f2-8886-ef13facfd67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:32.288542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-f7c735ae-3186-41f2-8886-ef13facfd67e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:32.289675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-f7c735ae-3186-41f2-8886-ef13facfd67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:32.296527 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 533/1065] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:32 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:32.318421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0b99f-254c-4087-bc76-8528634e3594 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:32.330500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0b99f-254c-4087-bc76-8528634e3594 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:32.334372 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b417339-30f1-42c6-baaf-0b805d3a6a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:32.335233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b417339-30f1-42c6-baaf-0b805d3a6a03 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:32.335655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b417339-30f1-42c6-baaf-0b805d3a6a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:32.335945 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b417339-30f1-42c6-baaf-0b805d3a6a03 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:32.346639 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b417339-30f1-42c6-baaf-0b805d3a6a03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:59:32.353179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-8b417339-30f1-42c6-baaf-0b805d3a6a03 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:59:32.354253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 533/1066] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:59:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:32.360581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c735ae-3186-41f2-8886-ef13facfd67e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:32.369846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c735ae-3186-41f2-8886-ef13facfd67e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:32.374015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a084-d8ab-4c14-9788-a6ed12b5bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:32.374609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a084-d8ab-4c14-9788-a6ed12b5bc79 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:32.374925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a084-d8ab-4c14-9788-a6ed12b5bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:32.375211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a084-d8ab-4c14-9788-a6ed12b5bc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:32.375915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1a084-d8ab-4c14-9788-a6ed12b5bc79 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:32.376214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1a084-d8ab-4c14-9788-a6ed12b5bc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:32.401613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1a084-d8ab-4c14-9788-a6ed12b5bc79 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:32.410236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 534/1067] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:59:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:32.416318 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b417339-30f1-42c6-baaf-0b805d3a6a03 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:32.426391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b417339-30f1-42c6-baaf-0b805d3a6a03 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:32.431002 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d7bc-2260-41ca-9bff-b18d84d5b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:32.431781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d7bc-2260-41ca-9bff-b18d84d5b441 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:32.432065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d7bc-2260-41ca-9bff-b18d84d5b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:32.432379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d7bc-2260-41ca-9bff-b18d84d5b441 admin admin] PATH_INFO: `/v3/users/56ed375dbd0f4d2493faa9d3c5695dab` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:32.433412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66d7bc-2260-41ca-9bff-b18d84d5b441 admin admin] RBAC: Authorizing `identity:get_user(user_id=56ed375dbd0f4d2493faa9d3c5695dab)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:32.459266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66d7bc-2260-41ca-9bff-b18d84d5b441 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:32.460829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 534/1068] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:32 2021] GET /identity/v3/users/56ed375dbd0f4d2493faa9d3c5695dab => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:32.466395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a084-d8ab-4c14-9788-a6ed12b5bc79 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:32.476519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a084-d8ab-4c14-9788-a6ed12b5bc79 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:32.482525 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa9bb4-1a4b-474e-b1c2-0f7f77a471b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:32.483343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa9bb4-1a4b-474e-b1c2-0f7f77a471b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:32.483631 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa9bb4-1a4b-474e-b1c2-0f7f77a471b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:32.484177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa9bb4-1a4b-474e-b1c2-0f7f77a471b2 admin admin] PATH_INFO: `/v3/projects/1e80d98f09924acdb64835c3e7c3f14a` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:32.485280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa9bb4-1a4b-474e-b1c2-0f7f77a471b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e80d98f09924acdb64835c3e7c3f14a)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:32.511239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa9bb4-1a4b-474e-b1c2-0f7f77a471b2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:32.512725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 535/1069] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:32 2021] GET /identity/v3/projects/1e80d98f09924acdb64835c3e7c3f14a => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:32.518756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d7bc-2260-41ca-9bff-b18d84d5b441 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:32.528346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d7bc-2260-41ca-9bff-b18d84d5b441 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:32.532406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f307b-20de-4e8c-a39f-265f314b195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:32.533215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f307b-20de-4e8c-a39f-265f314b195b admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:32.533509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f307b-20de-4e8c-a39f-265f314b195b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:32.533799 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f307b-20de-4e8c-a39f-265f314b195b admin admin] PATH_INFO: `/v3/projects/1e80d98f09924acdb64835c3e7c3f14a/users/56ed375dbd0f4d2493faa9d3c5695dab/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:32.535561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f307b-20de-4e8c-a39f-265f314b195b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e80d98f09924acdb64835c3e7c3f14a, user_id=56ed375dbd0f4d2493faa9d3c5695dab, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:32.562721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f307b-20de-4e8c-a39f-265f314b195b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:32.575428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 535/1070] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:59:32 2021] PUT /identity/v3/projects/1e80d98f09924acdb64835c3e7c3f14a/users/56ed375dbd0f4d2493faa9d3c5695dab/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:59:34.534603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26105-87cc-4380-aff7-7c0559f795d6 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:34.535173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26105-87cc-4380-aff7-7c0559f795d6 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:34.535289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26105-87cc-4380-aff7-7c0559f795d6 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:34.536881 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 536/1071] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:34.542110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cefa-67c9-41d1-b279-738a83c39782 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:34.542519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cefa-67c9-41d1-b279-738a83c39782 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:34.542702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cefa-67c9-41d1-b279-738a83c39782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:34.565285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0e18cefa-67c9-41d1-b279-738a83c39782 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:34.566419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0e18cefa-67c9-41d1-b279-738a83c39782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:34.630284 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 536/1072] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:34 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:34.653543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26105-87cc-4380-aff7-7c0559f795d6 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:34.665525 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26105-87cc-4380-aff7-7c0559f795d6 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:34.669425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac129717-1475-468e-a395-085adeb2dc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:34.670134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac129717-1475-468e-a395-085adeb2dc86 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:34.670421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac129717-1475-468e-a395-085adeb2dc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:34.670734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac129717-1475-468e-a395-085adeb2dc86 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:34.683274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac129717-1475-468e-a395-085adeb2dc86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:59:34.689516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-ac129717-1475-468e-a395-085adeb2dc86 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:59:34.690599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 537/1073] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:59:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:34.697259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cefa-67c9-41d1-b279-738a83c39782 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:34.705898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cefa-67c9-41d1-b279-738a83c39782 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:34.709902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02564d57-ff7b-4e02-bbf0-8f5f58e805e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:34.710520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02564d57-ff7b-4e02-bbf0-8f5f58e805e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:34.710806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02564d57-ff7b-4e02-bbf0-8f5f58e805e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:34.711085 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02564d57-ff7b-4e02-bbf0-8f5f58e805e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:34.711797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02564d57-ff7b-4e02-bbf0-8f5f58e805e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:34.712096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02564d57-ff7b-4e02-bbf0-8f5f58e805e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:34.737631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02564d57-ff7b-4e02-bbf0-8f5f58e805e6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:34.746751 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 537/1074] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:59:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:34.752488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac129717-1475-468e-a395-085adeb2dc86 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:34.761815 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac129717-1475-468e-a395-085adeb2dc86 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:34.765894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e850a5-6cf4-49b6-bd18-cbe1b818b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:34.766712 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e850a5-6cf4-49b6-bd18-cbe1b818b7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:34.767006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e850a5-6cf4-49b6-bd18-cbe1b818b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:34.767294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e850a5-6cf4-49b6-bd18-cbe1b818b7a8 admin admin] PATH_INFO: `/v3/users/56ed375dbd0f4d2493faa9d3c5695dab` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:34.768381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e850a5-6cf4-49b6-bd18-cbe1b818b7a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=56ed375dbd0f4d2493faa9d3c5695dab)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:34.795084 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e850a5-6cf4-49b6-bd18-cbe1b818b7a8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:34.796519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 538/1075] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:34 2021] GET /identity/v3/users/56ed375dbd0f4d2493faa9d3c5695dab => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:34.802160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02564d57-ff7b-4e02-bbf0-8f5f58e805e6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:34.816670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02564d57-ff7b-4e02-bbf0-8f5f58e805e6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:34.822450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a3d3f-3fce-4f45-b6c0-9532e4db2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:34.824792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a3d3f-3fce-4f45-b6c0-9532e4db2b79 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:34.824792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a3d3f-3fce-4f45-b6c0-9532e4db2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:34.824792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a3d3f-3fce-4f45-b6c0-9532e4db2b79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:34.833728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a3d3f-3fce-4f45-b6c0-9532e4db2b79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:34.859969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a3d3f-3fce-4f45-b6c0-9532e4db2b79 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:34.869674 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 538/1076] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:59:34 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:59:34.875658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e850a5-6cf4-49b6-bd18-cbe1b818b7a8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:34.884978 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e850a5-6cf4-49b6-bd18-cbe1b818b7a8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:34.889116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc356fd-20b0-411a-9a2c-e1c1189cc605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:34.889889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc356fd-20b0-411a-9a2c-e1c1189cc605 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:34.890179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc356fd-20b0-411a-9a2c-e1c1189cc605 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:34.890459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc356fd-20b0-411a-9a2c-e1c1189cc605 admin admin] PATH_INFO: `/v3/projects/1e80d98f09924acdb64835c3e7c3f14a` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:34.891555 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc356fd-20b0-411a-9a2c-e1c1189cc605 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e80d98f09924acdb64835c3e7c3f14a)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:34.917486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc356fd-20b0-411a-9a2c-e1c1189cc605 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:34.919060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 539/1077] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:34 2021] GET /identity/v3/projects/1e80d98f09924acdb64835c3e7c3f14a => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:34.924911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a3d3f-3fce-4f45-b6c0-9532e4db2b79 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:34.934307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a3d3f-3fce-4f45-b6c0-9532e4db2b79 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:34.938514 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2a086-09aa-434a-af52-f922a164d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:34.939122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2a086-09aa-434a-af52-f922a164d411 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:34.939412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2a086-09aa-434a-af52-f922a164d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:34.939703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2a086-09aa-434a-af52-f922a164d411 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:34.940475 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2a086-09aa-434a-af52-f922a164d411 admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=1e80d98f09924acdb64835c3e7c3f14a, user.id=56ed375dbd0f4d2493faa9d3c5695dab) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:34.940784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2a086-09aa-434a-af52-f922a164d411 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:34.966011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2a086-09aa-434a-af52-f922a164d411 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:34.971855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 539/1078] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:59:34 2021] GET /identity/v3/role_assignments?user.id=56ed375dbd0f4d2493faa9d3c5695dab&scope.project.id=1e80d98f09924acdb64835c3e7c3f14a&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 13:59:36.945871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c34172-1398-47f0-838f-80c191e91ba9 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:36.946403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c34172-1398-47f0-838f-80c191e91ba9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:36.946403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c34172-1398-47f0-838f-80c191e91ba9 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:36.948115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 540/1079] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 13:59:36.953270 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413009bd-6934-4e98-9963-7f89b5779678 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:36.953698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413009bd-6934-4e98-9963-7f89b5779678 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:36.953845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413009bd-6934-4e98-9963-7f89b5779678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:36.977378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-413009bd-6934-4e98-9963-7f89b5779678 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:36.978509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-413009bd-6934-4e98-9963-7f89b5779678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:36.985698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 540/1080] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:36 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:37.007481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c34172-1398-47f0-838f-80c191e91ba9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:37.019334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c34172-1398-47f0-838f-80c191e91ba9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:37.023989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddcd5b-0e64-4511-a5e0-abecaac56d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:37.024557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddcd5b-0e64-4511-a5e0-abecaac56d4a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:37.024842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddcd5b-0e64-4511-a5e0-abecaac56d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:37.025121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddcd5b-0e64-4511-a5e0-abecaac56d4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:37.032653 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddcd5b-0e64-4511-a5e0-abecaac56d4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:37.057665 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddcd5b-0e64-4511-a5e0-abecaac56d4a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:37.066115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 541/1081] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:59:37 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:59:37.072710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413009bd-6934-4e98-9963-7f89b5779678 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:37.081244 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413009bd-6934-4e98-9963-7f89b5779678 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:37.086011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466daa6f-dbff-4293-b918-9b7b8ce2c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:37.086776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466daa6f-dbff-4293-b918-9b7b8ce2c087 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:37.087072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466daa6f-dbff-4293-b918-9b7b8ce2c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:37.087358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466daa6f-dbff-4293-b918-9b7b8ce2c087 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:37.095268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466daa6f-dbff-4293-b918-9b7b8ce2c087 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:37.121461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466daa6f-dbff-4293-b918-9b7b8ce2c087 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:37.137217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-466daa6f-dbff-4293-b918-9b7b8ce2c087 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 27 13:59:37.138321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 541/1082] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 13:59:37 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:37.144506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddcd5b-0e64-4511-a5e0-abecaac56d4a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:37.153788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddcd5b-0e64-4511-a5e0-abecaac56d4a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:37.157905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56678559-f8b8-4e22-8e0c-671e6823a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:37.158483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56678559-f8b8-4e22-8e0c-671e6823a261 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:37.158812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56678559-f8b8-4e22-8e0c-671e6823a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:37.159097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56678559-f8b8-4e22-8e0c-671e6823a261 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:37.160056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56678559-f8b8-4e22-8e0c-671e6823a261 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:37.160357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56678559-f8b8-4e22-8e0c-671e6823a261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:37.186229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56678559-f8b8-4e22-8e0c-671e6823a261 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:37.195387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 542/1083] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Oct 27 13:59:37 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:39.149221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7903-38e7-4f63-bd56-593636460ab6 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:39.149808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7903-38e7-4f63-bd56-593636460ab6 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:39.149808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7903-38e7-4f63-bd56-593636460ab6 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:39.151501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 542/1084] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:39.156695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3de8a7-6c88-49a0-b2a5-ab1e35187dd3 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:39.157177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3de8a7-6c88-49a0-b2a5-ab1e35187dd3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:39.157276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3de8a7-6c88-49a0-b2a5-ab1e35187dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:39.180040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-0d3de8a7-6c88-49a0-b2a5-ab1e35187dd3 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:39.181163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0d3de8a7-6c88-49a0-b2a5-ab1e35187dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:39.187820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 543/1085] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:39 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:39.209323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7903-38e7-4f63-bd56-593636460ab6 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:39.221521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7903-38e7-4f63-bd56-593636460ab6 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:39.226108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b1bad-a5f8-4e5b-98c2-4b80dc3453a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:39.226792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b1bad-a5f8-4e5b-98c2-4b80dc3453a4 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:39.227092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b1bad-a5f8-4e5b-98c2-4b80dc3453a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:39.227380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b1bad-a5f8-4e5b-98c2-4b80dc3453a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:39.228075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b1bad-a5f8-4e5b-98c2-4b80dc3453a4 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:39.252887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-6e1b1bad-a5f8-4e5b-98c2-4b80dc3453a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 13:59:39.252887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 13:59:39.252887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 13:59:39.253755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b1bad-a5f8-4e5b-98c2-4b80dc3453a4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:39.268625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 543/1086] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 27 13:59:39 2021] POST /identity/v3/domains => generated 267 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:59:41.269597 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27b75-e57f-4f14-a60b-f91755bee36b None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:41.270122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27b75-e57f-4f14-a60b-f91755bee36b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:41.270122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27b75-e57f-4f14-a60b-f91755bee36b None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:41.271827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 544/1087] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:41.278573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d20d3-7413-4115-a8a4-71fd64988b60 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:41.279071 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d20d3-7413-4115-a8a4-71fd64988b60 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:41.279174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d20d3-7413-4115-a8a4-71fd64988b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:41.302317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6f2d20d3-7413-4115-a8a4-71fd64988b60 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:41.303477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6f2d20d3-7413-4115-a8a4-71fd64988b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:41.368296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 544/1088] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:41 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:41.390646 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a27b75-e57f-4f14-a60b-f91755bee36b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:41.402803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a27b75-e57f-4f14-a60b-f91755bee36b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:41.406742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd99f-2543-4deb-b678-41ac42d4c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:41.407526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd99f-2543-4deb-b678-41ac42d4c338 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:41.407813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd99f-2543-4deb-b678-41ac42d4c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:41.408096 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd99f-2543-4deb-b678-41ac42d4c338 admin admin] PATH_INFO: `/v3/domains/973e6b740de04396aab5e61fb79ce51f` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:41.420713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd99f-2543-4deb-b678-41ac42d4c338 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=973e6b740de04396aab5e61fb79ce51f)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:41.446115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd99f-2543-4deb-b678-41ac42d4c338 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:41.447636 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 545/1089] 10.222.0.36 () {56 vars in 1204 bytes} [Wed Oct 27 13:59:41 2021] GET /identity/v3/domains/973e6b740de04396aab5e61fb79ce51f => generated 267 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:41.453607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d20d3-7413-4115-a8a4-71fd64988b60 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:41.463361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d20d3-7413-4115-a8a4-71fd64988b60 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:41.467441 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cdac7-25c8-4640-a457-8f1866338df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:41.468021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cdac7-25c8-4640-a457-8f1866338df8 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:41.468312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cdac7-25c8-4640-a457-8f1866338df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:41.468596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cdac7-25c8-4640-a457-8f1866338df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:41.469261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cdac7-25c8-4640-a457-8f1866338df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:41.497392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cdac7-25c8-4640-a457-8f1866338df8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:41.526028 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 545/1090] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 13:59:41 2021] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 13:59:43.531589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b9f49-5b9b-4239-96b2-e7fd4f49d47f None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:43.532150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b9f49-5b9b-4239-96b2-e7fd4f49d47f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:43.532150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b9f49-5b9b-4239-96b2-e7fd4f49d47f None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:43.533840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 546/1091] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:43.539784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72253c2e-ff9e-4f46-a979-6e037dadbe14 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:43.540224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72253c2e-ff9e-4f46-a979-6e037dadbe14 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:43.540364 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72253c2e-ff9e-4f46-a979-6e037dadbe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:43.561886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-72253c2e-ff9e-4f46-a979-6e037dadbe14 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:43.563048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-72253c2e-ff9e-4f46-a979-6e037dadbe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:43.627057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 546/1092] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:43 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 13:59:43.651000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b9f49-5b9b-4239-96b2-e7fd4f49d47f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:43.662815 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b9f49-5b9b-4239-96b2-e7fd4f49d47f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:43.667389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e1a87-3ddb-4c33-abb8-6cf22c5c9bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:43.668180 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e1a87-3ddb-4c33-abb8-6cf22c5c9bae admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:43.668465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e1a87-3ddb-4c33-abb8-6cf22c5c9bae admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:43.668746 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e1a87-3ddb-4c33-abb8-6cf22c5c9bae admin admin] PATH_INFO: `/v3/domains/973e6b740de04396aab5e61fb79ce51f` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:43.669817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e1a87-3ddb-4c33-abb8-6cf22c5c9bae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=973e6b740de04396aab5e61fb79ce51f)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:43.695125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e1a87-3ddb-4c33-abb8-6cf22c5c9bae admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:43.696620 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 547/1093] 10.222.0.36 () {56 vars in 1204 bytes} [Wed Oct 27 13:59:43 2021] GET /identity/v3/domains/973e6b740de04396aab5e61fb79ce51f => generated 267 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:43.702511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72253c2e-ff9e-4f46-a979-6e037dadbe14 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:43.711888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72253c2e-ff9e-4f46-a979-6e037dadbe14 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:43.716225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f53fa3-f88b-463a-bb56-7ba030201ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:43.716838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f53fa3-f88b-463a-bb56-7ba030201ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:43.717128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f53fa3-f88b-463a-bb56-7ba030201ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:43.717414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f53fa3-f88b-463a-bb56-7ba030201ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:43.718088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f53fa3-f88b-463a-bb56-7ba030201ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:43.745731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f53fa3-f88b-463a-bb56-7ba030201ba0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:43.765818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 547/1094] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 13:59:43 2021] POST /identity/v3/users => generated 311 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 13:59:45.867004 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb945fe-0d24-458d-acaa-ac4d6eb1069c None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:45.867749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb945fe-0d24-458d-acaa-ac4d6eb1069c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:45.867749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb945fe-0d24-458d-acaa-ac4d6eb1069c None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:45.869264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 548/1095] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:45.874724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358437fc-b9a6-4a99-ad95-d0b5c0ffb83e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:45.875132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358437fc-b9a6-4a99-ad95-d0b5c0ffb83e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:45.875303 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358437fc-b9a6-4a99-ad95-d0b5c0ffb83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:45.898456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-358437fc-b9a6-4a99-ad95-d0b5c0ffb83e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:45.899638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-358437fc-b9a6-4a99-ad95-d0b5c0ffb83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:45.906791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 548/1096] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:45 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:45.932309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb945fe-0d24-458d-acaa-ac4d6eb1069c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:45.944302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb945fe-0d24-458d-acaa-ac4d6eb1069c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:45.948392 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e4077-831a-4887-83ec-2462ef6cf0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:45.949119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4077-831a-4887-83ec-2462ef6cf0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:45.949415 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4077-831a-4887-83ec-2462ef6cf0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:45.949700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4077-831a-4887-83ec-2462ef6cf0c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:45.961874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e4077-831a-4887-83ec-2462ef6cf0c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:59:45.968223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-4a8e4077-831a-4887-83ec-2462ef6cf0c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:59:45.969357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 549/1097] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:59:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:45.975699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358437fc-b9a6-4a99-ad95-d0b5c0ffb83e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:45.985320 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358437fc-b9a6-4a99-ad95-d0b5c0ffb83e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:45.989769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fba7c9-4c80-4147-b409-8fab201ff4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:45.990464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fba7c9-4c80-4147-b409-8fab201ff4ce admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:45.990843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fba7c9-4c80-4147-b409-8fab201ff4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:45.991202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fba7c9-4c80-4147-b409-8fab201ff4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:45.991981 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fba7c9-4c80-4147-b409-8fab201ff4ce admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:45.992347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fba7c9-4c80-4147-b409-8fab201ff4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:46.017859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fba7c9-4c80-4147-b409-8fab201ff4ce admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:46.028009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 549/1098] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:59:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:46.034044 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e4077-831a-4887-83ec-2462ef6cf0c4 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:46.044403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e4077-831a-4887-83ec-2462ef6cf0c4 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:46.048555 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f211b-3c8e-404e-a505-5e29320cef6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:46.049343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f211b-3c8e-404e-a505-5e29320cef6d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:46.049638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f211b-3c8e-404e-a505-5e29320cef6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:46.049923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f211b-3c8e-404e-a505-5e29320cef6d admin admin] PATH_INFO: `/v3/users/00974628e5654246861d9fdb13c87ac9` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:46.068113 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f211b-3c8e-404e-a505-5e29320cef6d admin admin] RBAC: Authorizing `identity:get_user(user_id=00974628e5654246861d9fdb13c87ac9)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:46.094966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f211b-3c8e-404e-a505-5e29320cef6d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:46.096572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 550/1099] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:46 2021] GET /identity/v3/users/00974628e5654246861d9fdb13c87ac9 => generated 311 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:46.102443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fba7c9-4c80-4147-b409-8fab201ff4ce admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:46.112199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fba7c9-4c80-4147-b409-8fab201ff4ce admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:46.116390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec2d5e-88ef-4bd8-84b3-7388f2ffdd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:46.116960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec2d5e-88ef-4bd8-84b3-7388f2ffdd45 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:46.117299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec2d5e-88ef-4bd8-84b3-7388f2ffdd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:46.117532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec2d5e-88ef-4bd8-84b3-7388f2ffdd45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:46.125287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec2d5e-88ef-4bd8-84b3-7388f2ffdd45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:46.151336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec2d5e-88ef-4bd8-84b3-7388f2ffdd45 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:46.160119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 550/1100] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:59:46 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:59:46.166259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f211b-3c8e-404e-a505-5e29320cef6d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:46.175650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f211b-3c8e-404e-a505-5e29320cef6d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:46.179819 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a8c5-9a2c-42ac-9200-77e6e9bd3d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:46.180592 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a8c5-9a2c-42ac-9200-77e6e9bd3d90 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:46.180878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a8c5-9a2c-42ac-9200-77e6e9bd3d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:46.181158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a8c5-9a2c-42ac-9200-77e6e9bd3d90 admin admin] PATH_INFO: `/v3/projects/cea479439d4b4c65b87afc7a2faa05e7` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:46.182216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a8c5-9a2c-42ac-9200-77e6e9bd3d90 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea479439d4b4c65b87afc7a2faa05e7)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:46.208053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a8c5-9a2c-42ac-9200-77e6e9bd3d90 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:46.209615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 551/1101] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:46 2021] GET /identity/v3/projects/cea479439d4b4c65b87afc7a2faa05e7 => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:46.216362 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec2d5e-88ef-4bd8-84b3-7388f2ffdd45 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:46.225747 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec2d5e-88ef-4bd8-84b3-7388f2ffdd45 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:46.229976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93b6ea-06cb-4ced-9064-e931a6762119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:46.230558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93b6ea-06cb-4ced-9064-e931a6762119 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:46.230887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93b6ea-06cb-4ced-9064-e931a6762119 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:46.231177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93b6ea-06cb-4ced-9064-e931a6762119 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:46.231948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93b6ea-06cb-4ced-9064-e931a6762119 admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=cea479439d4b4c65b87afc7a2faa05e7, user.id=00974628e5654246861d9fdb13c87ac9) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:46.232257 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93b6ea-06cb-4ced-9064-e931a6762119 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:46.259533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93b6ea-06cb-4ced-9064-e931a6762119 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:46.265366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 551/1102] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:59:46 2021] GET /identity/v3/role_assignments?user.id=00974628e5654246861d9fdb13c87ac9&scope.project.id=cea479439d4b4c65b87afc7a2faa05e7&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:48.229644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da18b2-b9f3-4123-b771-9e0f923934c9 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:48.230199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da18b2-b9f3-4123-b771-9e0f923934c9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:48.230199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da18b2-b9f3-4123-b771-9e0f923934c9 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:48.231927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 552/1103] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:48.238046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d130f-dc6d-42d4-bfb4-190505426cbd None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:48.238500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d130f-dc6d-42d4-bfb4-190505426cbd None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:48.238604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d130f-dc6d-42d4-bfb4-190505426cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:48.266785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0a0d130f-dc6d-42d4-bfb4-190505426cbd None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:48.267839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0a0d130f-dc6d-42d4-bfb4-190505426cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:48.276602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 552/1104] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:48 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:48.303047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da18b2-b9f3-4123-b771-9e0f923934c9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:48.315416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da18b2-b9f3-4123-b771-9e0f923934c9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:48.320089 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d5f4a-4c84-4a3a-a404-52f04f122852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:48.320869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d5f4a-4c84-4a3a-a404-52f04f122852 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:48.321161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d5f4a-4c84-4a3a-a404-52f04f122852 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:48.321443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d5f4a-4c84-4a3a-a404-52f04f122852 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:48.332714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d5f4a-4c84-4a3a-a404-52f04f122852 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:59:48.340048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-3e5d5f4a-4c84-4a3a-a404-52f04f122852 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:59:48.341152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 553/1105] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:59:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:48.347510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d130f-dc6d-42d4-bfb4-190505426cbd None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:48.356247 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d130f-dc6d-42d4-bfb4-190505426cbd None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:48.360655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c8a2c-7b7b-43c8-a161-e2fcd047caec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:48.361248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c8a2c-7b7b-43c8-a161-e2fcd047caec admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:48.361541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c8a2c-7b7b-43c8-a161-e2fcd047caec admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:48.361828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c8a2c-7b7b-43c8-a161-e2fcd047caec admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:48.362537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c8a2c-7b7b-43c8-a161-e2fcd047caec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:48.362873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c8a2c-7b7b-43c8-a161-e2fcd047caec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:48.388815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c8a2c-7b7b-43c8-a161-e2fcd047caec admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:48.398524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 553/1106] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:59:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:48.404467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d5f4a-4c84-4a3a-a404-52f04f122852 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:48.414982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d5f4a-4c84-4a3a-a404-52f04f122852 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:48.419111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4d256-f116-4065-a74b-d540bbcbc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:48.419895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4d256-f116-4065-a74b-d540bbcbc1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:48.420183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4d256-f116-4065-a74b-d540bbcbc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:48.420465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4d256-f116-4065-a74b-d540bbcbc1b4 admin admin] PATH_INFO: `/v3/users/00974628e5654246861d9fdb13c87ac9` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:48.421556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4d256-f116-4065-a74b-d540bbcbc1b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=00974628e5654246861d9fdb13c87ac9)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:48.448052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4d256-f116-4065-a74b-d540bbcbc1b4 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:48.449561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 554/1107] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:48 2021] GET /identity/v3/users/00974628e5654246861d9fdb13c87ac9 => generated 311 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:48.455357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c8a2c-7b7b-43c8-a161-e2fcd047caec admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:48.465428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c8a2c-7b7b-43c8-a161-e2fcd047caec admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:48.469602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d8f80-98bd-47bc-9cb4-2f16e4128508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:48.470381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d8f80-98bd-47bc-9cb4-2f16e4128508 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:48.470701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d8f80-98bd-47bc-9cb4-2f16e4128508 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:48.470991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d8f80-98bd-47bc-9cb4-2f16e4128508 admin admin] PATH_INFO: `/v3/projects/cea479439d4b4c65b87afc7a2faa05e7` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:48.472072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d8f80-98bd-47bc-9cb4-2f16e4128508 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea479439d4b4c65b87afc7a2faa05e7)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:48.498737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d8f80-98bd-47bc-9cb4-2f16e4128508 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:48.500353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 554/1108] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:48 2021] GET /identity/v3/projects/cea479439d4b4c65b87afc7a2faa05e7 => generated 361 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:48.506246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4d256-f116-4065-a74b-d540bbcbc1b4 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:48.516287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4d256-f116-4065-a74b-d540bbcbc1b4 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:48.520369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c71675-264f-4f9a-8caa-6d1f47945f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:48.521118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c71675-264f-4f9a-8caa-6d1f47945f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:48.521402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c71675-264f-4f9a-8caa-6d1f47945f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:48.521678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c71675-264f-4f9a-8caa-6d1f47945f4a admin admin] PATH_INFO: `/v3/projects/cea479439d4b4c65b87afc7a2faa05e7/users/00974628e5654246861d9fdb13c87ac9/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:48.524037 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c71675-264f-4f9a-8caa-6d1f47945f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea479439d4b4c65b87afc7a2faa05e7, user_id=00974628e5654246861d9fdb13c87ac9, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:48.549933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c71675-264f-4f9a-8caa-6d1f47945f4a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:48.571764 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 555/1109] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 13:59:48 2021] PUT /identity/v3/projects/cea479439d4b4c65b87afc7a2faa05e7/users/00974628e5654246861d9fdb13c87ac9/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 13:59:50.537187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6cb6e-5b64-4611-92a9-a59dcd5de26b None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:50.537761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6cb6e-5b64-4611-92a9-a59dcd5de26b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:50.537862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6cb6e-5b64-4611-92a9-a59dcd5de26b None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:50.539526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 555/1110] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 13:59:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 13:59:50.544683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70478b-115d-4b4c-a3bf-96e7814849ce None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:50.545068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70478b-115d-4b4c-a3bf-96e7814849ce None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:50.545250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70478b-115d-4b4c-a3bf-96e7814849ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:50.568481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-cf70478b-115d-4b4c-a3bf-96e7814849ce None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 13:59:50.570433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cf70478b-115d-4b4c-a3bf-96e7814849ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 13:59:50.637142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 556/1111] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 13:59:50 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 13:59:50.660528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6cb6e-5b64-4611-92a9-a59dcd5de26b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:50.672146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6cb6e-5b64-4611-92a9-a59dcd5de26b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:50.676139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9625ce-53f3-44b3-9177-845dd52c2274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:50.676847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9625ce-53f3-44b3-9177-845dd52c2274 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:50.677134 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9625ce-53f3-44b3-9177-845dd52c2274 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:50.677413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9625ce-53f3-44b3-9177-845dd52c2274 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:50.689691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9625ce-53f3-44b3-9177-845dd52c2274 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 13:59:50.696610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-ce9625ce-53f3-44b3-9177-845dd52c2274 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 13:59:50.697721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 556/1112] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 13:59:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 13:59:50.704116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70478b-115d-4b4c-a3bf-96e7814849ce None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:50.713372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70478b-115d-4b4c-a3bf-96e7814849ce None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:50.717966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e278f84-716d-4667-bae3-d25d6299730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:50.718556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e278f84-716d-4667-bae3-d25d6299730f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:50.718872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e278f84-716d-4667-bae3-d25d6299730f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:50.719153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e278f84-716d-4667-bae3-d25d6299730f admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:50.719856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e278f84-716d-4667-bae3-d25d6299730f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:50.720154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e278f84-716d-4667-bae3-d25d6299730f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:50.749622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e278f84-716d-4667-bae3-d25d6299730f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:50.759301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 557/1113] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 13:59:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:50.765211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9625ce-53f3-44b3-9177-845dd52c2274 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:50.775368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9625ce-53f3-44b3-9177-845dd52c2274 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:50.779513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019f11-cc14-4156-ba0e-408d29026c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:50.780311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019f11-cc14-4156-ba0e-408d29026c74 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:50.780602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019f11-cc14-4156-ba0e-408d29026c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:50.780884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019f11-cc14-4156-ba0e-408d29026c74 admin admin] PATH_INFO: `/v3/users/00974628e5654246861d9fdb13c87ac9` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:50.781987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019f11-cc14-4156-ba0e-408d29026c74 admin admin] RBAC: Authorizing `identity:get_user(user_id=00974628e5654246861d9fdb13c87ac9)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:50.807982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019f11-cc14-4156-ba0e-408d29026c74 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:50.809437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 557/1114] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 13:59:50 2021] GET /identity/v3/users/00974628e5654246861d9fdb13c87ac9 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:50.815348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e278f84-716d-4667-bae3-d25d6299730f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:50.825640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e278f84-716d-4667-bae3-d25d6299730f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:50.829826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d596f19-f80c-4254-bc5f-e9339d9c1417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:50.830401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d596f19-f80c-4254-bc5f-e9339d9c1417 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:50.830719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d596f19-f80c-4254-bc5f-e9339d9c1417 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:50.831006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d596f19-f80c-4254-bc5f-e9339d9c1417 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:50.839849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d596f19-f80c-4254-bc5f-e9339d9c1417 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:50.866418 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d596f19-f80c-4254-bc5f-e9339d9c1417 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:50.876142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 558/1115] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 13:59:50 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 13:59:50.882906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019f11-cc14-4156-ba0e-408d29026c74 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:50.892299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019f11-cc14-4156-ba0e-408d29026c74 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:50.896592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4743c-849d-47be-8d40-a445c5b3038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:50.897404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4743c-849d-47be-8d40-a445c5b3038f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:50.897685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4743c-849d-47be-8d40-a445c5b3038f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:50.897969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4743c-849d-47be-8d40-a445c5b3038f admin admin] PATH_INFO: `/v3/projects/cea479439d4b4c65b87afc7a2faa05e7` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:50.899242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4743c-849d-47be-8d40-a445c5b3038f admin admin] RBAC: Authorizing `identity:get_project(project_id=cea479439d4b4c65b87afc7a2faa05e7)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:50.924894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4743c-849d-47be-8d40-a445c5b3038f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:50.926830 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 558/1116] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 13:59:50 2021] GET /identity/v3/projects/cea479439d4b4c65b87afc7a2faa05e7 => generated 361 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 13:59:50.936344 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d596f19-f80c-4254-bc5f-e9339d9c1417 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 13:59:50.949086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d596f19-f80c-4254-bc5f-e9339d9c1417 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 13:59:50.953255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579b802-ec52-4621-bd7f-e9d59b56741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 13:59:50.953838 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b802-ec52-4621-bd7f-e9d59b56741a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 13:59:50.954129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b802-ec52-4621-bd7f-e9d59b56741a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 13:59:50.954414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579b802-ec52-4621-bd7f-e9d59b56741a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 13:59:50.955227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579b802-ec52-4621-bd7f-e9d59b56741a admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=cea479439d4b4c65b87afc7a2faa05e7, user.id=00974628e5654246861d9fdb13c87ac9) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 13:59:50.955534 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579b802-ec52-4621-bd7f-e9d59b56741a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 13:59:50.982004 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579b802-ec52-4621-bd7f-e9d59b56741a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 13:59:50.988843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 559/1117] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 13:59:50 2021] GET /identity/v3/role_assignments?user.id=00974628e5654246861d9fdb13c87ac9&scope.project.id=cea479439d4b4c65b87afc7a2faa05e7&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:20.352809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ccc30-4de4-4619-9db7-8f2c167325a1 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:20.353369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ccc30-4de4-4619-9db7-8f2c167325a1 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:20.353369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ccc30-4de4-4619-9db7-8f2c167325a1 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:20.355085 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 559/1118] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:20.360564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617110fb-46db-4c76-991c-4f7f5e169131 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:20.360992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617110fb-46db-4c76-991c-4f7f5e169131 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:20.361138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617110fb-46db-4c76-991c-4f7f5e169131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:20.383967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-617110fb-46db-4c76-991c-4f7f5e169131 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:20.385116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-617110fb-46db-4c76-991c-4f7f5e169131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:20.392298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 560/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:20 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:01:20.416531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ccc30-4de4-4619-9db7-8f2c167325a1 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:20.428306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ccc30-4de4-4619-9db7-8f2c167325a1 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:20.432807 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6a62f-c771-4982-a3ea-abf5ceb18641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:20.433513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6a62f-c771-4982-a3ea-abf5ceb18641 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:20.433803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6a62f-c771-4982-a3ea-abf5ceb18641 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:20.434091 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6a62f-c771-4982-a3ea-abf5ceb18641 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:20.446562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6a62f-c771-4982-a3ea-abf5ceb18641 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:20.471542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6a62f-c771-4982-a3ea-abf5ceb18641 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:20.488258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-3bd6a62f-c771-4982-a3ea-abf5ceb18641 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:20.489317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 560/1120] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:20.495809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617110fb-46db-4c76-991c-4f7f5e169131 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:20.504310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617110fb-46db-4c76-991c-4f7f5e169131 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:20.508962 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290826a-dbb0-44a4-b587-c8a195e4a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:20.509537 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290826a-dbb0-44a4-b587-c8a195e4a110 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:20.509824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290826a-dbb0-44a4-b587-c8a195e4a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:20.510105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290826a-dbb0-44a4-b587-c8a195e4a110 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:20.510811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290826a-dbb0-44a4-b587-c8a195e4a110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:20.511108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290826a-dbb0-44a4-b587-c8a195e4a110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:20.536602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290826a-dbb0-44a4-b587-c8a195e4a110 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:20.550670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 561/1121] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:20.556967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6a62f-c771-4982-a3ea-abf5ceb18641 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:20.566176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6a62f-c771-4982-a3ea-abf5ceb18641 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:20.570187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac968eb5-a42f-4e50-b4df-f4ba2a6f0c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:20.571709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac968eb5-a42f-4e50-b4df-f4ba2a6f0c4f admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:20.572001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac968eb5-a42f-4e50-b4df-f4ba2a6f0c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:20.572289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac968eb5-a42f-4e50-b4df-f4ba2a6f0c4f admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:20.572927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac968eb5-a42f-4e50-b4df-f4ba2a6f0c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:20.598482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac968eb5-a42f-4e50-b4df-f4ba2a6f0c4f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:20.619603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 561/1122] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Oct 27 14:01:20 2021] POST /identity/v3/users => generated 251 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:01:22.792487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16c89a-9c7b-4b8f-818b-f2b5052ccc8b None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:22.793043 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16c89a-9c7b-4b8f-818b-f2b5052ccc8b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:22.793043 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16c89a-9c7b-4b8f-818b-f2b5052ccc8b None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:22.794707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 562/1123] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:22.799904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f8f81-3cfc-4804-9203-2721f18230f0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:22.800752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f8f81-3cfc-4804-9203-2721f18230f0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:22.801103 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f8f81-3cfc-4804-9203-2721f18230f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:22.824750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c19f8f81-3cfc-4804-9203-2721f18230f0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:22.825971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c19f8f81-3cfc-4804-9203-2721f18230f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:22.833011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 562/1124] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:01:22.856707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16c89a-9c7b-4b8f-818b-f2b5052ccc8b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:22.869336 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16c89a-9c7b-4b8f-818b-f2b5052ccc8b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:22.873287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94720a-7833-48df-a558-5dd985b95adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:22.874009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94720a-7833-48df-a558-5dd985b95adc admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:22.874300 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94720a-7833-48df-a558-5dd985b95adc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:22.874581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94720a-7833-48df-a558-5dd985b95adc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:22.886834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94720a-7833-48df-a558-5dd985b95adc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:01:22.893125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-9b94720a-7833-48df-a558-5dd985b95adc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:01:22.894271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 563/1125] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 14:01:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:22.900562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f8f81-3cfc-4804-9203-2721f18230f0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:22.909756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f8f81-3cfc-4804-9203-2721f18230f0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:22.913909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305ceb7-c283-4132-8c84-bd2699734a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:22.914648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305ceb7-c283-4132-8c84-bd2699734a7d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:22.915005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305ceb7-c283-4132-8c84-bd2699734a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:22.915296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305ceb7-c283-4132-8c84-bd2699734a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:22.916032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305ceb7-c283-4132-8c84-bd2699734a7d admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:22.916339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305ceb7-c283-4132-8c84-bd2699734a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:22.942237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305ceb7-c283-4132-8c84-bd2699734a7d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:22.952352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 563/1126] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 14:01:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:22.958279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94720a-7833-48df-a558-5dd985b95adc admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:22.979108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94720a-7833-48df-a558-5dd985b95adc admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:22.984893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db292258-4ba1-473a-ab05-9c38000cf104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:22.985940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db292258-4ba1-473a-ab05-9c38000cf104 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:22.986259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db292258-4ba1-473a-ab05-9c38000cf104 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:22.986551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db292258-4ba1-473a-ab05-9c38000cf104 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.001445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db292258-4ba1-473a-ab05-9c38000cf104 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.028364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db292258-4ba1-473a-ab05-9c38000cf104 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.049173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-db292258-4ba1-473a-ab05-9c38000cf104 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:23.050365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 564/1127] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:23.059163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305ceb7-c283-4132-8c84-bd2699734a7d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:23.068536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305ceb7-c283-4132-8c84-bd2699734a7d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:23.072694 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f6420-8277-44c5-964e-5df3697e6845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:23.073280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6420-8277-44c5-964e-5df3697e6845 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:23.073572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6420-8277-44c5-964e-5df3697e6845 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:23.073862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6420-8277-44c5-964e-5df3697e6845 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.074545 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f6420-8277-44c5-964e-5df3697e6845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:23.074880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f6420-8277-44c5-964e-5df3697e6845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.100367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f6420-8277-44c5-964e-5df3697e6845 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.115353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 564/1128] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:23.121876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db292258-4ba1-473a-ab05-9c38000cf104 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:23.131214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db292258-4ba1-473a-ab05-9c38000cf104 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:23.135623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cbae7-ab58-4f3c-b10c-4f43ed51e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:23.136352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbae7-ab58-4f3c-b10c-4f43ed51e435 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:23.136692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbae7-ab58-4f3c-b10c-4f43ed51e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:23.136931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbae7-ab58-4f3c-b10c-4f43ed51e435 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.149900 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cbae7-ab58-4f3c-b10c-4f43ed51e435 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.176689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cbae7-ab58-4f3c-b10c-4f43ed51e435 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.195110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-295cbae7-ab58-4f3c-b10c-4f43ed51e435 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:01:23.196232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 565/1129] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:23 2021] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:23.201943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f6420-8277-44c5-964e-5df3697e6845 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:23.211122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f6420-8277-44c5-964e-5df3697e6845 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:23.215560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae4734-973b-426e-a62e-ca03f576fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:23.216150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae4734-973b-426e-a62e-ca03f576fcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:23.216439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae4734-973b-426e-a62e-ca03f576fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:23.216722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae4734-973b-426e-a62e-ca03f576fcd3 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.217508 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae4734-973b-426e-a62e-ca03f576fcd3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:23.217811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae4734-973b-426e-a62e-ca03f576fcd3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.244969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae4734-973b-426e-a62e-ca03f576fcd3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.273195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 565/1130] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Oct 27 14:01:23 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:23.279119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cbae7-ab58-4f3c-b10c-4f43ed51e435 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:23.288313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cbae7-ab58-4f3c-b10c-4f43ed51e435 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:23.292827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e012075-f3d9-4e4e-9918-26658869d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:23.293385 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e012075-f3d9-4e4e-9918-26658869d26b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:23.293671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e012075-f3d9-4e4e-9918-26658869d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:23.293954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e012075-f3d9-4e4e-9918-26658869d26b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.301459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e012075-f3d9-4e4e-9918-26658869d26b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.327314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e012075-f3d9-4e4e-9918-26658869d26b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.336645 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 566/1131] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 14:01:23 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:01:23.342485 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae4734-973b-426e-a62e-ca03f576fcd3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:23.351687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae4734-973b-426e-a62e-ca03f576fcd3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:23.356510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62ad28-be94-48c7-b2c8-066ff1085f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:23.357226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62ad28-be94-48c7-b2c8-066ff1085f79 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:23.357521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62ad28-be94-48c7-b2c8-066ff1085f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:23.357810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62ad28-be94-48c7-b2c8-066ff1085f79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.370110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62ad28-be94-48c7-b2c8-066ff1085f79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.395404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62ad28-be94-48c7-b2c8-066ff1085f79 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.412150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-be62ad28-be94-48c7-b2c8-066ff1085f79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:23.413235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 566/1132] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:23.419678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e012075-f3d9-4e4e-9918-26658869d26b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:23.428647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e012075-f3d9-4e4e-9918-26658869d26b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:23.433653 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cbdd3-e99d-4507-bbe2-950aaad77d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:23.434236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cbdd3-e99d-4507-bbe2-950aaad77d3b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:23.434529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cbdd3-e99d-4507-bbe2-950aaad77d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:23.434851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cbdd3-e99d-4507-bbe2-950aaad77d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.435533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cbdd3-e99d-4507-bbe2-950aaad77d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:23.435839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cbdd3-e99d-4507-bbe2-950aaad77d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.460914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cbdd3-e99d-4507-bbe2-950aaad77d3b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.474273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 567/1133] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:23.480831 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62ad28-be94-48c7-b2c8-066ff1085f79 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:23.490424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62ad28-be94-48c7-b2c8-066ff1085f79 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:23.494584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37c8d-5c52-4e03-acd0-ff24a04ed269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:23.495316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37c8d-5c52-4e03-acd0-ff24a04ed269 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:23.495605 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37c8d-5c52-4e03-acd0-ff24a04ed269 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:23.495888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37c8d-5c52-4e03-acd0-ff24a04ed269 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.504636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce37c8d-5c52-4e03-acd0-ff24a04ed269 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.530128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce37c8d-5c52-4e03-acd0-ff24a04ed269 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.543959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-4ce37c8d-5c52-4e03-acd0-ff24a04ed269 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:01:23.545014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 567/1134] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 14:01:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:23.550865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cbdd3-e99d-4507-bbe2-950aaad77d3b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:23.560365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cbdd3-e99d-4507-bbe2-950aaad77d3b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:23.564416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefd8fd-3856-48b4-8d60-dd334498dc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:23.564998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefd8fd-3856-48b4-8d60-dd334498dc07 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:23.565289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefd8fd-3856-48b4-8d60-dd334498dc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:23.565570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefd8fd-3856-48b4-8d60-dd334498dc07 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.566314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefd8fd-3856-48b4-8d60-dd334498dc07 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:23.566615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefd8fd-3856-48b4-8d60-dd334498dc07 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.592963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefd8fd-3856-48b4-8d60-dd334498dc07 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.606486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 568/1135] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 14:01:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:23.613499 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37c8d-5c52-4e03-acd0-ff24a04ed269 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:23.623037 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37c8d-5c52-4e03-acd0-ff24a04ed269 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:23.627108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce7244-dcb3-4bd0-976e-012272a1b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:23.627685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce7244-dcb3-4bd0-976e-012272a1b86c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:23.627968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce7244-dcb3-4bd0-976e-012272a1b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:23.628252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce7244-dcb3-4bd0-976e-012272a1b86c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:23.629026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce7244-dcb3-4bd0-976e-012272a1b86c admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=78404f52618b4d86a2a478f18b136773) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:23.629354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce7244-dcb3-4bd0-976e-012272a1b86c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:23.655867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce7244-dcb3-4bd0-976e-012272a1b86c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:23.661135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 568/1136] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 14:01:23 2021] GET /identity/v3/role_assignments?user.id=78404f52618b4d86a2a478f18b136773&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:25.658246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece029b5-856a-4439-87a6-b4992b2395c1 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:25.658833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece029b5-856a-4439-87a6-b4992b2395c1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:25.658833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece029b5-856a-4439-87a6-b4992b2395c1 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:25.660521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 569/1137] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:25.666147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bf0e3-24b8-4c5d-9936-ee157db8228b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:25.666522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bf0e3-24b8-4c5d-9936-ee157db8228b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:25.666765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bf0e3-24b8-4c5d-9936-ee157db8228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:25.690006 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-648bf0e3-24b8-4c5d-9936-ee157db8228b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:25.691998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-648bf0e3-24b8-4c5d-9936-ee157db8228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:25.701371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 569/1138] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:25 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:01:25.723889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece029b5-856a-4439-87a6-b4992b2395c1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:25.740564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece029b5-856a-4439-87a6-b4992b2395c1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:25.745243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdfbb9-2b22-4577-9155-b063921131bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:25.745956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdfbb9-2b22-4577-9155-b063921131bf admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:25.746248 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdfbb9-2b22-4577-9155-b063921131bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:25.746533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdfbb9-2b22-4577-9155-b063921131bf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:25.757602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdfbb9-2b22-4577-9155-b063921131bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:01:25.764616 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-bdfdfbb9-2b22-4577-9155-b063921131bf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:01:25.765711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 570/1139] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 14:01:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:25.771962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bf0e3-24b8-4c5d-9936-ee157db8228b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:25.780809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bf0e3-24b8-4c5d-9936-ee157db8228b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:25.785839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cad306-5e49-4810-bc4f-88111cb0b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:25.786456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cad306-5e49-4810-bc4f-88111cb0b846 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:25.786791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cad306-5e49-4810-bc4f-88111cb0b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:25.787080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cad306-5e49-4810-bc4f-88111cb0b846 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:25.787789 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cad306-5e49-4810-bc4f-88111cb0b846 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:25.788093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cad306-5e49-4810-bc4f-88111cb0b846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:25.813678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cad306-5e49-4810-bc4f-88111cb0b846 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:25.823237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 570/1140] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 14:01:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:25.829034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdfbb9-2b22-4577-9155-b063921131bf admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:25.839075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdfbb9-2b22-4577-9155-b063921131bf admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:25.843155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16430-a9d9-4650-b57e-7613234f0d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:25.843955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16430-a9d9-4650-b57e-7613234f0d6a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:25.844356 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16430-a9d9-4650-b57e-7613234f0d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:25.844729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16430-a9d9-4650-b57e-7613234f0d6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:25.856165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde16430-a9d9-4650-b57e-7613234f0d6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:25.881891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde16430-a9d9-4650-b57e-7613234f0d6a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:25.900358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-fde16430-a9d9-4650-b57e-7613234f0d6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:25.901663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 571/1141] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:25.907884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cad306-5e49-4810-bc4f-88111cb0b846 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:25.917451 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cad306-5e49-4810-bc4f-88111cb0b846 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:25.921455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de20ac3-c01d-470e-b70d-40163af396a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:25.922039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de20ac3-c01d-470e-b70d-40163af396a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:25.922329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de20ac3-c01d-470e-b70d-40163af396a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:25.922610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de20ac3-c01d-470e-b70d-40163af396a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:25.923311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de20ac3-c01d-470e-b70d-40163af396a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:25.923668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de20ac3-c01d-470e-b70d-40163af396a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:25.949570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de20ac3-c01d-470e-b70d-40163af396a9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:25.965169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 571/1142] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:25.971292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16430-a9d9-4650-b57e-7613234f0d6a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:25.982419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16430-a9d9-4650-b57e-7613234f0d6a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:25.987425 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9956e-0f03-47bc-9a77-5e9733f18ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:25.988162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9956e-0f03-47bc-9a77-5e9733f18ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:25.988451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9956e-0f03-47bc-9a77-5e9733f18ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:25.988736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9956e-0f03-47bc-9a77-5e9733f18ca8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:26.003780 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9956e-0f03-47bc-9a77-5e9733f18ca8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:26.038817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9956e-0f03-47bc-9a77-5e9733f18ca8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:26.060544 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-b1f9956e-0f03-47bc-9a77-5e9733f18ca8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:01:26.061662 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 572/1143] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:25 2021] GET /identity/v3/users/placement => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:26.067617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de20ac3-c01d-470e-b70d-40163af396a9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:26.076905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de20ac3-c01d-470e-b70d-40163af396a9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:26.080973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da342a-7563-410d-bf7a-84423c33d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:26.081561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da342a-7563-410d-bf7a-84423c33d52a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:26.081852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da342a-7563-410d-bf7a-84423c33d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:26.082137 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da342a-7563-410d-bf7a-84423c33d52a admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:26.082962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da342a-7563-410d-bf7a-84423c33d52a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:26.083266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da342a-7563-410d-bf7a-84423c33d52a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:26.109194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da342a-7563-410d-bf7a-84423c33d52a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:26.138147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 572/1144] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Oct 27 14:01:26 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:26.143825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9956e-0f03-47bc-9a77-5e9733f18ca8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:26.153126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9956e-0f03-47bc-9a77-5e9733f18ca8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:26.157182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf6e24-c113-47f1-aa03-9bdec43a0781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:26.157890 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf6e24-c113-47f1-aa03-9bdec43a0781 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:26.158180 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf6e24-c113-47f1-aa03-9bdec43a0781 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:26.158461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf6e24-c113-47f1-aa03-9bdec43a0781 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:26.171226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf6e24-c113-47f1-aa03-9bdec43a0781 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:26.196816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf6e24-c113-47f1-aa03-9bdec43a0781 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:26.213312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-cbdf6e24-c113-47f1-aa03-9bdec43a0781 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:26.214378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 573/1145] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:26.220191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da342a-7563-410d-bf7a-84423c33d52a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:26.229933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da342a-7563-410d-bf7a-84423c33d52a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:26.234280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfb8a-8ee7-46be-ba65-e146d86fad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:26.234917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfb8a-8ee7-46be-ba65-e146d86fad1b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:26.235206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfb8a-8ee7-46be-ba65-e146d86fad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:26.235491 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfb8a-8ee7-46be-ba65-e146d86fad1b admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:26.236174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dfb8a-8ee7-46be-ba65-e146d86fad1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:26.236483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dfb8a-8ee7-46be-ba65-e146d86fad1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:26.262256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dfb8a-8ee7-46be-ba65-e146d86fad1b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:26.275166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 573/1146] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:26.280919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf6e24-c113-47f1-aa03-9bdec43a0781 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:26.291109 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf6e24-c113-47f1-aa03-9bdec43a0781 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:26.295191 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6acd2-0834-40d6-9bdf-d0857edb28d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:26.295900 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6acd2-0834-40d6-9bdf-d0857edb28d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:26.296198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6acd2-0834-40d6-9bdf-d0857edb28d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:26.296483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6acd2-0834-40d6-9bdf-d0857edb28d3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:26.306280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6acd2-0834-40d6-9bdf-d0857edb28d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:26.331540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6acd2-0834-40d6-9bdf-d0857edb28d3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:26.344886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-67a6acd2-0834-40d6-9bdf-d0857edb28d3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:01:26.345970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 574/1147] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 14:01:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:26.351716 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfb8a-8ee7-46be-ba65-e146d86fad1b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:26.361854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfb8a-8ee7-46be-ba65-e146d86fad1b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:26.365980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1d9b5-7e10-4fff-87d0-11ab878bed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:26.366564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1d9b5-7e10-4fff-87d0-11ab878bed9d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:26.366900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1d9b5-7e10-4fff-87d0-11ab878bed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:26.367189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1d9b5-7e10-4fff-87d0-11ab878bed9d admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:26.368652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1d9b5-7e10-4fff-87d0-11ab878bed9d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:26.368961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1d9b5-7e10-4fff-87d0-11ab878bed9d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:26.394868 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1d9b5-7e10-4fff-87d0-11ab878bed9d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:26.413269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 574/1148] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 14:01:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:01:26.422619 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6acd2-0834-40d6-9bdf-d0857edb28d3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:26.433772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6acd2-0834-40d6-9bdf-d0857edb28d3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:26.438657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9e9ca-28f2-4fff-aab6-800b72bd1843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:26.439509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9e9ca-28f2-4fff-aab6-800b72bd1843 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:26.439801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9e9ca-28f2-4fff-aab6-800b72bd1843 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:26.440084 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9e9ca-28f2-4fff-aab6-800b72bd1843 admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/78404f52618b4d86a2a478f18b136773/roles/18aaf45888374560a4c11e1912d42c97` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:26.462266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9e9ca-28f2-4fff-aab6-800b72bd1843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=78404f52618b4d86a2a478f18b136773, role_id=18aaf45888374560a4c11e1912d42c97)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:26.490870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9e9ca-28f2-4fff-aab6-800b72bd1843 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:26.506433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 575/1149] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 14:01:26 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/78404f52618b4d86a2a478f18b136773/roles/18aaf45888374560a4c11e1912d42c97 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:01:28.486353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f2e5c-74e1-4cf3-b69d-158e0bfa90a0 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:28.486959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f2e5c-74e1-4cf3-b69d-158e0bfa90a0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:28.487062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f2e5c-74e1-4cf3-b69d-158e0bfa90a0 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:28.488735 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 575/1150] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:28.494239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed33e-2974-4b6a-8394-dac3087eb9b6 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:28.494693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed33e-2974-4b6a-8394-dac3087eb9b6 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:28.494860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed33e-2974-4b6a-8394-dac3087eb9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:28.517717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b2bed33e-2974-4b6a-8394-dac3087eb9b6 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:28.518873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b2bed33e-2974-4b6a-8394-dac3087eb9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:28.582752 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 576/1151] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:01:28.606338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f2e5c-74e1-4cf3-b69d-158e0bfa90a0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:28.618292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f2e5c-74e1-4cf3-b69d-158e0bfa90a0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:28.622227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8119ef6-8329-493e-9ddf-326a6aad9425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:28.622980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8119ef6-8329-493e-9ddf-326a6aad9425 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:28.623273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8119ef6-8329-493e-9ddf-326a6aad9425 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:28.623556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8119ef6-8329-493e-9ddf-326a6aad9425 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:28.635111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8119ef6-8329-493e-9ddf-326a6aad9425 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:01:28.641439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-c8119ef6-8329-493e-9ddf-326a6aad9425 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:01:28.642520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 576/1152] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Oct 27 14:01:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:28.648548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed33e-2974-4b6a-8394-dac3087eb9b6 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:28.657914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed33e-2974-4b6a-8394-dac3087eb9b6 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:28.662006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f9da1-a35a-4634-b6b9-ba50a3ac693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:28.662577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f9da1-a35a-4634-b6b9-ba50a3ac693e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:28.662901 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f9da1-a35a-4634-b6b9-ba50a3ac693e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:28.663185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f9da1-a35a-4634-b6b9-ba50a3ac693e admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:28.663897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f9da1-a35a-4634-b6b9-ba50a3ac693e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:28.664201 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f9da1-a35a-4634-b6b9-ba50a3ac693e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:28.690339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f9da1-a35a-4634-b6b9-ba50a3ac693e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:28.699474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 577/1153] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Oct 27 14:01:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:01:28.705112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8119ef6-8329-493e-9ddf-326a6aad9425 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:28.715184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8119ef6-8329-493e-9ddf-326a6aad9425 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:28.719212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a94476-84bf-4533-a389-91e6eefb28ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:28.719921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a94476-84bf-4533-a389-91e6eefb28ff admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:28.720209 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a94476-84bf-4533-a389-91e6eefb28ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:28.720493 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a94476-84bf-4533-a389-91e6eefb28ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:28.731422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a94476-84bf-4533-a389-91e6eefb28ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:28.757546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a94476-84bf-4533-a389-91e6eefb28ff admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:28.776715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-c7a94476-84bf-4533-a389-91e6eefb28ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:28.777783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 577/1154] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:28.783553 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f9da1-a35a-4634-b6b9-ba50a3ac693e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:28.793148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f9da1-a35a-4634-b6b9-ba50a3ac693e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:28.797180 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30cd83-34b5-4490-8cbb-c9c43cdee51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:28.797759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30cd83-34b5-4490-8cbb-c9c43cdee51a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:28.798050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30cd83-34b5-4490-8cbb-c9c43cdee51a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:28.798333 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30cd83-34b5-4490-8cbb-c9c43cdee51a admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:28.799051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30cd83-34b5-4490-8cbb-c9c43cdee51a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:28.799352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30cd83-34b5-4490-8cbb-c9c43cdee51a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:28.825538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30cd83-34b5-4490-8cbb-c9c43cdee51a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:28.838959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 578/1155] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:28.844739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a94476-84bf-4533-a389-91e6eefb28ff admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:28.854360 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a94476-84bf-4533-a389-91e6eefb28ff admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:28.858701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392a748-e39d-4bae-93ee-e9ba947480a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:28.859427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392a748-e39d-4bae-93ee-e9ba947480a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:28.859710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392a748-e39d-4bae-93ee-e9ba947480a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:28.859989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392a748-e39d-4bae-93ee-e9ba947480a9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:28.873256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392a748-e39d-4bae-93ee-e9ba947480a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:28.899286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392a748-e39d-4bae-93ee-e9ba947480a9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:28.917001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-c392a748-e39d-4bae-93ee-e9ba947480a9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:01:28.918087 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 578/1156] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:28 2021] GET /identity/v3/users/placement => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:28.924034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30cd83-34b5-4490-8cbb-c9c43cdee51a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:28.933999 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30cd83-34b5-4490-8cbb-c9c43cdee51a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:28.938118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cbbfe-97d1-4c37-90b0-410c8c93fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:28.938742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cbbfe-97d1-4c37-90b0-410c8c93fbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:28.939033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cbbfe-97d1-4c37-90b0-410c8c93fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:28.939315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cbbfe-97d1-4c37-90b0-410c8c93fbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:28.940098 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cbbfe-97d1-4c37-90b0-410c8c93fbd2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:28.940406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cbbfe-97d1-4c37-90b0-410c8c93fbd2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:28.968476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cbbfe-97d1-4c37-90b0-410c8c93fbd2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:29.001070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 579/1157] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Oct 27 14:01:28 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:29.006803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392a748-e39d-4bae-93ee-e9ba947480a9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:29.016984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392a748-e39d-4bae-93ee-e9ba947480a9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:29.021102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d23c8-8303-4ad2-88c5-eff3e259eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:29.021684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d23c8-8303-4ad2-88c5-eff3e259eee8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:29.021974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d23c8-8303-4ad2-88c5-eff3e259eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:29.022260 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d23c8-8303-4ad2-88c5-eff3e259eee8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:29.030444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d23c8-8303-4ad2-88c5-eff3e259eee8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:29.056778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d23c8-8303-4ad2-88c5-eff3e259eee8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:29.066216 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 579/1158] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 14:01:29 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:01:29.072369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cbbfe-97d1-4c37-90b0-410c8c93fbd2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:29.081667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cbbfe-97d1-4c37-90b0-410c8c93fbd2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:29.085786 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f64f-3cbd-4bdd-96fc-c9fdf0e60644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:29.086613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f64f-3cbd-4bdd-96fc-c9fdf0e60644 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:29.086935 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f64f-3cbd-4bdd-96fc-c9fdf0e60644 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:29.087220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f64f-3cbd-4bdd-96fc-c9fdf0e60644 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:29.098511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4f64f-3cbd-4bdd-96fc-c9fdf0e60644 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:29.125005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4f64f-3cbd-4bdd-96fc-c9fdf0e60644 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:29.141650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-b7e4f64f-3cbd-4bdd-96fc-c9fdf0e60644 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:29.142751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 580/1159] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:29.148968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d23c8-8303-4ad2-88c5-eff3e259eee8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:29.157369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d23c8-8303-4ad2-88c5-eff3e259eee8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:29.161458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbac994-7a81-43f3-87bb-5df690b848df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:29.162034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbac994-7a81-43f3-87bb-5df690b848df admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:29.162320 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbac994-7a81-43f3-87bb-5df690b848df admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:29.162600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbac994-7a81-43f3-87bb-5df690b848df admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:29.163307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbac994-7a81-43f3-87bb-5df690b848df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:29.163601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbac994-7a81-43f3-87bb-5df690b848df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:29.189476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbac994-7a81-43f3-87bb-5df690b848df admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:29.202010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 580/1160] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:29.207782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f64f-3cbd-4bdd-96fc-c9fdf0e60644 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:29.217101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f64f-3cbd-4bdd-96fc-c9fdf0e60644 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:29.221183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b0ee9-b5e4-4c61-a198-0e596987669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:29.221888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b0ee9-b5e4-4c61-a198-0e596987669b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:29.222180 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b0ee9-b5e4-4c61-a198-0e596987669b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:29.222462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b0ee9-b5e4-4c61-a198-0e596987669b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:29.231875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b0ee9-b5e4-4c61-a198-0e596987669b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:29.257878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b0ee9-b5e4-4c61-a198-0e596987669b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:29.271374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-4b5b0ee9-b5e4-4c61-a198-0e596987669b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:01:29.272372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 581/1161] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 14:01:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:29.278314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbac994-7a81-43f3-87bb-5df690b848df admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:29.287589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbac994-7a81-43f3-87bb-5df690b848df admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:29.292464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f0a80-97ec-4c06-a7be-0da6fa5ca697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:29.293044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f0a80-97ec-4c06-a7be-0da6fa5ca697 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:29.293336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f0a80-97ec-4c06-a7be-0da6fa5ca697 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:29.293625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f0a80-97ec-4c06-a7be-0da6fa5ca697 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:29.294365 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f0a80-97ec-4c06-a7be-0da6fa5ca697 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:29.294701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f0a80-97ec-4c06-a7be-0da6fa5ca697 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:29.320485 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f0a80-97ec-4c06-a7be-0da6fa5ca697 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:29.333577 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 581/1162] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 14:01:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:29.339645 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b0ee9-b5e4-4c61-a198-0e596987669b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:29.348795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b0ee9-b5e4-4c61-a198-0e596987669b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:29.353454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992c33c-164f-4d69-b151-15cd5b9c95d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:29.354027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992c33c-164f-4d69-b151-15cd5b9c95d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:29.354320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992c33c-164f-4d69-b151-15cd5b9c95d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:29.354604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992c33c-164f-4d69-b151-15cd5b9c95d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:29.355410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992c33c-164f-4d69-b151-15cd5b9c95d4 admin admin] RBAC: Adding query filter params (role.id=18aaf45888374560a4c11e1912d42c97, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=78404f52618b4d86a2a478f18b136773) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:29.355716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992c33c-164f-4d69-b151-15cd5b9c95d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:29.381758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992c33c-164f-4d69-b151-15cd5b9c95d4 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:29.387814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 582/1163] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 14:01:29 2021] GET /identity/v3/role_assignments?user.id=78404f52618b4d86a2a478f18b136773&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=18aaf45888374560a4c11e1912d42c97 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:31.408017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162eaf-3580-4625-a2f3-17a6e8a94666 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.408551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162eaf-3580-4625-a2f3-17a6e8a94666 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.408656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162eaf-3580-4625-a2f3-17a6e8a94666 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.410297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 582/1164] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:31.415818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437814f9-5af9-4fed-9e8a-e343680893e9 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.416308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437814f9-5af9-4fed-9e8a-e343680893e9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.416405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437814f9-5af9-4fed-9e8a-e343680893e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.439274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-437814f9-5af9-4fed-9e8a-e343680893e9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:31.440401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-437814f9-5af9-4fed-9e8a-e343680893e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:31.447270 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 583/1165] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:01:31.469401 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162eaf-3580-4625-a2f3-17a6e8a94666 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:31.481648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162eaf-3580-4625-a2f3-17a6e8a94666 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:31.485863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc830d4-a835-42d5-95cc-e48bedd5ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:31.486580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc830d4-a835-42d5-95cc-e48bedd5ab36 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.486903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc830d4-a835-42d5-95cc-e48bedd5ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.487188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc830d4-a835-42d5-95cc-e48bedd5ab36 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.498906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc830d4-a835-42d5-95cc-e48bedd5ab36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:01:31.505128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-cfc830d4-a835-42d5-95cc-e48bedd5ab36 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:01:31.506215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 583/1166] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 14:01:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:31.512249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437814f9-5af9-4fed-9e8a-e343680893e9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:31.520929 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437814f9-5af9-4fed-9e8a-e343680893e9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:31.525069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9ffd8-8b59-4e4a-927a-64862dee57b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:31.525650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9ffd8-8b59-4e4a-927a-64862dee57b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.525939 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9ffd8-8b59-4e4a-927a-64862dee57b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.526219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9ffd8-8b59-4e4a-927a-64862dee57b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.527025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9ffd8-8b59-4e4a-927a-64862dee57b9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:31.527318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9ffd8-8b59-4e4a-927a-64862dee57b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:31.553083 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9ffd8-8b59-4e4a-927a-64862dee57b9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:31.562325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 584/1167] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 14:01:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:31.568174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc830d4-a835-42d5-95cc-e48bedd5ab36 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:31.577965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc830d4-a835-42d5-95cc-e48bedd5ab36 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:31.582062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3df842-80c8-4d20-a85e-a6b9cd346a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:31.582804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3df842-80c8-4d20-a85e-a6b9cd346a65 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.583099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3df842-80c8-4d20-a85e-a6b9cd346a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.583384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3df842-80c8-4d20-a85e-a6b9cd346a65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.594961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3df842-80c8-4d20-a85e-a6b9cd346a65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:31.622295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3df842-80c8-4d20-a85e-a6b9cd346a65 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:31.640050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-ab3df842-80c8-4d20-a85e-a6b9cd346a65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:31.641135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 584/1168] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:31.646977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9ffd8-8b59-4e4a-927a-64862dee57b9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:31.656512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9ffd8-8b59-4e4a-927a-64862dee57b9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:31.660607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde787f-2c1b-4405-a450-e32f58b981da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:31.661132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde787f-2c1b-4405-a450-e32f58b981da admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.661420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde787f-2c1b-4405-a450-e32f58b981da admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.661702 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde787f-2c1b-4405-a450-e32f58b981da admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.662379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde787f-2c1b-4405-a450-e32f58b981da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:31.662707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde787f-2c1b-4405-a450-e32f58b981da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:31.689857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde787f-2c1b-4405-a450-e32f58b981da admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:31.702584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 585/1169] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:31.708362 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3df842-80c8-4d20-a85e-a6b9cd346a65 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:31.718077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3df842-80c8-4d20-a85e-a6b9cd346a65 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:31.722068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f065cb3-082a-428e-a8cb-b8ab6e6dfe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:31.722813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065cb3-082a-428e-a8cb-b8ab6e6dfe94 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.723104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065cb3-082a-428e-a8cb-b8ab6e6dfe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.723389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065cb3-082a-428e-a8cb-b8ab6e6dfe94 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.736612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f065cb3-082a-428e-a8cb-b8ab6e6dfe94 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:31.761793 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f065cb3-082a-428e-a8cb-b8ab6e6dfe94 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:31.780057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-8f065cb3-082a-428e-a8cb-b8ab6e6dfe94 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:01:31.781162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 585/1170] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:31 2021] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:31.787133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde787f-2c1b-4405-a450-e32f58b981da admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:31.797440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde787f-2c1b-4405-a450-e32f58b981da admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:31.801515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd2cc8-8773-4ee1-8a28-25b7bd4f20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:31.802105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd2cc8-8773-4ee1-8a28-25b7bd4f20af admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.802396 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd2cc8-8773-4ee1-8a28-25b7bd4f20af admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.802717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd2cc8-8773-4ee1-8a28-25b7bd4f20af admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.803499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd2cc8-8773-4ee1-8a28-25b7bd4f20af admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:31.803803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd2cc8-8773-4ee1-8a28-25b7bd4f20af admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:31.830148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd2cc8-8773-4ee1-8a28-25b7bd4f20af admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:31.863336 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 586/1171] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Oct 27 14:01:31 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:31.869485 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f065cb3-082a-428e-a8cb-b8ab6e6dfe94 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:31.878890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f065cb3-082a-428e-a8cb-b8ab6e6dfe94 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:31.883008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259582-a809-4805-ad1a-7e202fb41ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:31.883875 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259582-a809-4805-ad1a-7e202fb41ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.884184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259582-a809-4805-ad1a-7e202fb41ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.884470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259582-a809-4805-ad1a-7e202fb41ae7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.892066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73259582-a809-4805-ad1a-7e202fb41ae7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:31.918888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73259582-a809-4805-ad1a-7e202fb41ae7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:31.928582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 586/1172] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 14:01:31 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:01:31.935004 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd2cc8-8773-4ee1-8a28-25b7bd4f20af admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:31.944941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd2cc8-8773-4ee1-8a28-25b7bd4f20af admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:31.949309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc971af-e14c-4679-97e7-7fb4e3515453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:31.950053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc971af-e14c-4679-97e7-7fb4e3515453 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:31.950345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc971af-e14c-4679-97e7-7fb4e3515453 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:31.950719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc971af-e14c-4679-97e7-7fb4e3515453 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:31.963304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc971af-e14c-4679-97e7-7fb4e3515453 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:31.991352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc971af-e14c-4679-97e7-7fb4e3515453 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:32.009934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-cfc971af-e14c-4679-97e7-7fb4e3515453 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:32.011116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 587/1173] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:32.017050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259582-a809-4805-ad1a-7e202fb41ae7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:32.026535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259582-a809-4805-ad1a-7e202fb41ae7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:32.030927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25157ec3-f191-4de6-a05d-d79041395da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:32.031517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25157ec3-f191-4de6-a05d-d79041395da7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:32.031809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25157ec3-f191-4de6-a05d-d79041395da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:32.032093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25157ec3-f191-4de6-a05d-d79041395da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:32.032771 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25157ec3-f191-4de6-a05d-d79041395da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:32.033074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25157ec3-f191-4de6-a05d-d79041395da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:32.059762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25157ec3-f191-4de6-a05d-d79041395da7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:32.073511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 587/1174] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:32.079444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc971af-e14c-4679-97e7-7fb4e3515453 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:32.089452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc971af-e14c-4679-97e7-7fb4e3515453 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:32.093518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd67cf-842a-4789-a804-7df1fc132278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:32.094225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd67cf-842a-4789-a804-7df1fc132278 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:32.094517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd67cf-842a-4789-a804-7df1fc132278 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:32.094835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd67cf-842a-4789-a804-7df1fc132278 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:32.103804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd67cf-842a-4789-a804-7df1fc132278 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:32.129349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd67cf-842a-4789-a804-7df1fc132278 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:32.143599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-aabd67cf-842a-4789-a804-7df1fc132278 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:01:32.144665 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 588/1175] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 14:01:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:32.151371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25157ec3-f191-4de6-a05d-d79041395da7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:32.160589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25157ec3-f191-4de6-a05d-d79041395da7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:32.164923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31d512-1d51-42a4-b168-f6f46fef520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:32.165507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d512-1d51-42a4-b168-f6f46fef520b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:32.165800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d512-1d51-42a4-b168-f6f46fef520b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:32.166087 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d512-1d51-42a4-b168-f6f46fef520b admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:32.166858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31d512-1d51-42a4-b168-f6f46fef520b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:32.167166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31d512-1d51-42a4-b168-f6f46fef520b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:32.192402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31d512-1d51-42a4-b168-f6f46fef520b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:32.205857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 588/1176] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 14:01:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:32.212542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd67cf-842a-4789-a804-7df1fc132278 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:32.221763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd67cf-842a-4789-a804-7df1fc132278 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:32.225784 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212d99f-c3fe-441c-98a9-c24fc8e22f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:32.226365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212d99f-c3fe-441c-98a9-c24fc8e22f3e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:32.226689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212d99f-c3fe-441c-98a9-c24fc8e22f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:32.226979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212d99f-c3fe-441c-98a9-c24fc8e22f3e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:32.227849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212d99f-c3fe-441c-98a9-c24fc8e22f3e admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=78404f52618b4d86a2a478f18b136773) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:32.228158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212d99f-c3fe-441c-98a9-c24fc8e22f3e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:32.253702 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212d99f-c3fe-441c-98a9-c24fc8e22f3e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:32.259545 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 589/1177] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 14:01:32 2021] GET /identity/v3/role_assignments?user.id=78404f52618b4d86a2a478f18b136773&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:34.243757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ffb0-622d-4126-8790-58753d3a3255 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.244316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ffb0-622d-4126-8790-58753d3a3255 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.244316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ffb0-622d-4126-8790-58753d3a3255 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.246021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 589/1178] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:34.251327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e413d8-b446-4502-9139-c58c0986855f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.251749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e413d8-b446-4502-9139-c58c0986855f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.251896 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e413d8-b446-4502-9139-c58c0986855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.275399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-58e413d8-b446-4502-9139-c58c0986855f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:34.276456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-58e413d8-b446-4502-9139-c58c0986855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:34.283313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 590/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:34 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:01:34.305768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388ffb0-622d-4126-8790-58753d3a3255 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.317400 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388ffb0-622d-4126-8790-58753d3a3255 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.322092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa438d81-3af2-4f3f-9682-75188b0f0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.322853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438d81-3af2-4f3f-9682-75188b0f0745 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.323148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438d81-3af2-4f3f-9682-75188b0f0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.323431 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438d81-3af2-4f3f-9682-75188b0f0745 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.334531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa438d81-3af2-4f3f-9682-75188b0f0745 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:01:34.341307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-fa438d81-3af2-4f3f-9682-75188b0f0745 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:01:34.342381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 590/1180] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:34.348437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e413d8-b446-4502-9139-c58c0986855f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.357151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e413d8-b446-4502-9139-c58c0986855f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.361618 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a57d1e-f9ad-444c-80ff-8447473168e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.362206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a57d1e-f9ad-444c-80ff-8447473168e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.362497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a57d1e-f9ad-444c-80ff-8447473168e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.362903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a57d1e-f9ad-444c-80ff-8447473168e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.363614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a57d1e-f9ad-444c-80ff-8447473168e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:34.363918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a57d1e-f9ad-444c-80ff-8447473168e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:34.389403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a57d1e-f9ad-444c-80ff-8447473168e3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:34.398109 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 591/1181] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:34.404623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa438d81-3af2-4f3f-9682-75188b0f0745 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.414646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa438d81-3af2-4f3f-9682-75188b0f0745 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.418841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229c998-d137-473e-aaba-4337ec7783fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.419576 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229c998-d137-473e-aaba-4337ec7783fa admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.419891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229c998-d137-473e-aaba-4337ec7783fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.420178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229c998-d137-473e-aaba-4337ec7783fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.432402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229c998-d137-473e-aaba-4337ec7783fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:34.458305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229c998-d137-473e-aaba-4337ec7783fa admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:34.477045 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-9229c998-d137-473e-aaba-4337ec7783fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:34.478112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 591/1182] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:34.484272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a57d1e-f9ad-444c-80ff-8447473168e3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.493739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a57d1e-f9ad-444c-80ff-8447473168e3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.497994 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bbe01-317d-4446-8433-01ff98510149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.498572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bbe01-317d-4446-8433-01ff98510149 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.498890 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bbe01-317d-4446-8433-01ff98510149 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.499179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bbe01-317d-4446-8433-01ff98510149 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.499861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bbe01-317d-4446-8433-01ff98510149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:34.500167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bbe01-317d-4446-8433-01ff98510149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:34.526420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bbe01-317d-4446-8433-01ff98510149 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:34.539166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 592/1183] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:34.545016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229c998-d137-473e-aaba-4337ec7783fa admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.554290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229c998-d137-473e-aaba-4337ec7783fa admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.558553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42158-5071-4273-9263-16a7dc95b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.559302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42158-5071-4273-9263-16a7dc95b584 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.559596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42158-5071-4273-9263-16a7dc95b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.559884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42158-5071-4273-9263-16a7dc95b584 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.572881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f42158-5071-4273-9263-16a7dc95b584 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:34.599019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f42158-5071-4273-9263-16a7dc95b584 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:34.617573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-e9f42158-5071-4273-9263-16a7dc95b584 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:01:34.618678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 592/1184] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/users/placement => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:34.624496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bbe01-317d-4446-8433-01ff98510149 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.634788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bbe01-317d-4446-8433-01ff98510149 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.638920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c395caf-9c03-48b2-ae82-89d0e1d6072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.639511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395caf-9c03-48b2-ae82-89d0e1d6072c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.639801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395caf-9c03-48b2-ae82-89d0e1d6072c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.640086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395caf-9c03-48b2-ae82-89d0e1d6072c admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.640868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c395caf-9c03-48b2-ae82-89d0e1d6072c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:34.641170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c395caf-9c03-48b2-ae82-89d0e1d6072c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:34.667734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c395caf-9c03-48b2-ae82-89d0e1d6072c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:34.697494 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 593/1185] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:34.703462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42158-5071-4273-9263-16a7dc95b584 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.712792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42158-5071-4273-9263-16a7dc95b584 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.716945 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad5f6b-01cd-4edf-a623-23d37f82c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.717654 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad5f6b-01cd-4edf-a623-23d37f82c44c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.717941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad5f6b-01cd-4edf-a623-23d37f82c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.718226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad5f6b-01cd-4edf-a623-23d37f82c44c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.730578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad5f6b-01cd-4edf-a623-23d37f82c44c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:34.756429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad5f6b-01cd-4edf-a623-23d37f82c44c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:34.773612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-a1ad5f6b-01cd-4edf-a623-23d37f82c44c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:34.774758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 593/1186] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:34.780565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c395caf-9c03-48b2-ae82-89d0e1d6072c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.789966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c395caf-9c03-48b2-ae82-89d0e1d6072c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.794129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb2c2b-2956-4437-8aad-e1554671be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.794737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb2c2b-2956-4437-8aad-e1554671be00 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.795032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb2c2b-2956-4437-8aad-e1554671be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.795320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb2c2b-2956-4437-8aad-e1554671be00 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.795997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb2c2b-2956-4437-8aad-e1554671be00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:34.796294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb2c2b-2956-4437-8aad-e1554671be00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:34.823259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb2c2b-2956-4437-8aad-e1554671be00 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:34.836701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 594/1187] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:34.842592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad5f6b-01cd-4edf-a623-23d37f82c44c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.852169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad5f6b-01cd-4edf-a623-23d37f82c44c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.856292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9d1b2-3a6e-4886-9b33-876a556d9731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.857009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d1b2-3a6e-4886-9b33-876a556d9731 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.857300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d1b2-3a6e-4886-9b33-876a556d9731 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.857584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d1b2-3a6e-4886-9b33-876a556d9731 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.866866 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d1b2-3a6e-4886-9b33-876a556d9731 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:34.893473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d1b2-3a6e-4886-9b33-876a556d9731 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:34.907408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-26e9d1b2-3a6e-4886-9b33-876a556d9731 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:01:34.908501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 594/1188] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:34.914587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb2c2b-2956-4437-8aad-e1554671be00 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.923869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb2c2b-2956-4437-8aad-e1554671be00 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.928034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d39fa-4436-4c11-9a1b-d0a6844b26c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.928617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d39fa-4436-4c11-9a1b-d0a6844b26c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.928909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d39fa-4436-4c11-9a1b-d0a6844b26c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.929197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d39fa-4436-4c11-9a1b-d0a6844b26c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.930497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d39fa-4436-4c11-9a1b-d0a6844b26c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:34.930856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d39fa-4436-4c11-9a1b-d0a6844b26c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:34.956658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d39fa-4436-4c11-9a1b-d0a6844b26c3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:34.970130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 595/1189] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 14:01:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:34.976022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9d1b2-3a6e-4886-9b33-876a556d9731 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:34.986324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9d1b2-3a6e-4886-9b33-876a556d9731 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:34.990468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c69825-54cf-4130-a069-f0a4553f129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:34.991384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c69825-54cf-4130-a069-f0a4553f129b admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:34.991679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c69825-54cf-4130-a069-f0a4553f129b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:34.991961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c69825-54cf-4130-a069-f0a4553f129b admin admin] PATH_INFO: `/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/78404f52618b4d86a2a478f18b136773/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:34.994681 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c69825-54cf-4130-a069-f0a4553f129b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd358f713924c24991a83b329dfcb8e, user_id=78404f52618b4d86a2a478f18b136773, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:35.021416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c69825-54cf-4130-a069-f0a4553f129b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:35.034237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 595/1190] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Oct 27 14:01:34 2021] PUT /identity/v3/projects/0dd358f713924c24991a83b329dfcb8e/users/78404f52618b4d86a2a478f18b136773/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:01:36.985657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961943b-04a4-4a1f-b731-d0f894181bad None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:36.986288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961943b-04a4-4a1f-b731-d0f894181bad None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:36.986288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961943b-04a4-4a1f-b731-d0f894181bad None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:36.987983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 596/1191] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:36.993644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fe0c9-99c8-4bc2-a75d-2fb7b95960d4 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:36.994084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fe0c9-99c8-4bc2-a75d-2fb7b95960d4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:36.994203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fe0c9-99c8-4bc2-a75d-2fb7b95960d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.017182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-071fe0c9-99c8-4bc2-a75d-2fb7b95960d4 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:37.018325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-071fe0c9-99c8-4bc2-a75d-2fb7b95960d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:37.081738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 596/1192] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:36 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:01:37.104469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961943b-04a4-4a1f-b731-d0f894181bad None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.116275 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961943b-04a4-4a1f-b731-d0f894181bad None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.120712 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cc001-5ff4-46d8-9521-bfdb259b68df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.121423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cc001-5ff4-46d8-9521-bfdb259b68df admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.121715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cc001-5ff4-46d8-9521-bfdb259b68df admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.122003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cc001-5ff4-46d8-9521-bfdb259b68df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.132959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cc001-5ff4-46d8-9521-bfdb259b68df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:01:37.139993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-9e2cc001-5ff4-46d8-9521-bfdb259b68df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:01:37.141121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 597/1193] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:37.147179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fe0c9-99c8-4bc2-a75d-2fb7b95960d4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.156244 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fe0c9-99c8-4bc2-a75d-2fb7b95960d4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.160334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972fa0-0546-4f23-9f6c-495ded677470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.160922 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972fa0-0546-4f23-9f6c-495ded677470 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.161211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972fa0-0546-4f23-9f6c-495ded677470 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.161497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972fa0-0546-4f23-9f6c-495ded677470 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.162202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0972fa0-0546-4f23-9f6c-495ded677470 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:37.162500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0972fa0-0546-4f23-9f6c-495ded677470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.189811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0972fa0-0546-4f23-9f6c-495ded677470 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.199302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 597/1194] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:37.205136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cc001-5ff4-46d8-9521-bfdb259b68df admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.215093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cc001-5ff4-46d8-9521-bfdb259b68df admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.219158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d68b99-eab8-4f00-9d20-1b019aba79ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.219869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d68b99-eab8-4f00-9d20-1b019aba79ed admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.220164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d68b99-eab8-4f00-9d20-1b019aba79ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.220453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d68b99-eab8-4f00-9d20-1b019aba79ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.231724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d68b99-eab8-4f00-9d20-1b019aba79ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.257889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d68b99-eab8-4f00-9d20-1b019aba79ed admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.275716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-f7d68b99-eab8-4f00-9d20-1b019aba79ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:37.276792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 598/1195] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:37.282504 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972fa0-0546-4f23-9f6c-495ded677470 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.292521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972fa0-0546-4f23-9f6c-495ded677470 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.296619 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce555fa5-d36b-4389-8dfa-99a67f1a9c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.297200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce555fa5-d36b-4389-8dfa-99a67f1a9c40 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.297493 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce555fa5-d36b-4389-8dfa-99a67f1a9c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.297780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce555fa5-d36b-4389-8dfa-99a67f1a9c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.298466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce555fa5-d36b-4389-8dfa-99a67f1a9c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:37.298805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce555fa5-d36b-4389-8dfa-99a67f1a9c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.324315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce555fa5-d36b-4389-8dfa-99a67f1a9c40 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.337011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 598/1196] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:37.342607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d68b99-eab8-4f00-9d20-1b019aba79ed admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.352312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d68b99-eab8-4f00-9d20-1b019aba79ed admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.356506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ade7fe-ed34-4f0f-8b8b-3251bf8ec66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.357212 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ade7fe-ed34-4f0f-8b8b-3251bf8ec66a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.357500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ade7fe-ed34-4f0f-8b8b-3251bf8ec66a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.357780 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ade7fe-ed34-4f0f-8b8b-3251bf8ec66a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.371105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ade7fe-ed34-4f0f-8b8b-3251bf8ec66a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.396473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ade7fe-ed34-4f0f-8b8b-3251bf8ec66a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.415233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-f0ade7fe-ed34-4f0f-8b8b-3251bf8ec66a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:01:37.417174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 599/1197] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:37.424554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce555fa5-d36b-4389-8dfa-99a67f1a9c40 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.435353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce555fa5-d36b-4389-8dfa-99a67f1a9c40 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.439555 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79005c-a77b-4f18-9502-1477b4923f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.440151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79005c-a77b-4f18-9502-1477b4923f10 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.440443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79005c-a77b-4f18-9502-1477b4923f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.440728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79005c-a77b-4f18-9502-1477b4923f10 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.441519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79005c-a77b-4f18-9502-1477b4923f10 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:37.441822 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79005c-a77b-4f18-9502-1477b4923f10 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.467407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79005c-a77b-4f18-9502-1477b4923f10 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.497410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 599/1198] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:37.503354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ade7fe-ed34-4f0f-8b8b-3251bf8ec66a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.512783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ade7fe-ed34-4f0f-8b8b-3251bf8ec66a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.516807 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1056-ded5-4aa4-af6d-c2b00e514b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.517380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1056-ded5-4aa4-af6d-c2b00e514b0a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.517672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1056-ded5-4aa4-af6d-c2b00e514b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.517957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1056-ded5-4aa4-af6d-c2b00e514b0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.525588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e1056-ded5-4aa4-af6d-c2b00e514b0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.551426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e1056-ded5-4aa4-af6d-c2b00e514b0a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.562770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 600/1199] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:01:37.568579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79005c-a77b-4f18-9502-1477b4923f10 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.577765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79005c-a77b-4f18-9502-1477b4923f10 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.581843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fd6fc-79ca-423f-a720-7d788dc2a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.582556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fd6fc-79ca-423f-a720-7d788dc2a6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.582877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fd6fc-79ca-423f-a720-7d788dc2a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.583164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fd6fc-79ca-423f-a720-7d788dc2a6b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.594453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fd6fc-79ca-423f-a720-7d788dc2a6b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.621062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fd6fc-79ca-423f-a720-7d788dc2a6b1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.637787 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-341fd6fc-79ca-423f-a720-7d788dc2a6b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:01:37.638902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 600/1200] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:37.644510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1056-ded5-4aa4-af6d-c2b00e514b0a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.653351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1056-ded5-4aa4-af6d-c2b00e514b0a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.657537 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc73290-db61-4d39-bd2d-a65b0b1949a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.658128 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc73290-db61-4d39-bd2d-a65b0b1949a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.658419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc73290-db61-4d39-bd2d-a65b0b1949a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.658749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc73290-db61-4d39-bd2d-a65b0b1949a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.659427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc73290-db61-4d39-bd2d-a65b0b1949a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:37.659731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc73290-db61-4d39-bd2d-a65b0b1949a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.686201 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc73290-db61-4d39-bd2d-a65b0b1949a9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.698973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 601/1201] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:37.704457 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fd6fc-79ca-423f-a720-7d788dc2a6b1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.714098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fd6fc-79ca-423f-a720-7d788dc2a6b1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.718227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df610728-d5df-48b5-9c61-152b38ed4e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.718968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df610728-d5df-48b5-9c61-152b38ed4e09 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.719256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df610728-d5df-48b5-9c61-152b38ed4e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.719535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df610728-d5df-48b5-9c61-152b38ed4e09 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.729607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df610728-d5df-48b5-9c61-152b38ed4e09 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.755260 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df610728-d5df-48b5-9c61-152b38ed4e09 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.768647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING keystone.server.flask.application [None req-df610728-d5df-48b5-9c61-152b38ed4e09 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:01:37.769654 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 601/1202] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:37.776197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc73290-db61-4d39-bd2d-a65b0b1949a9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.785326 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc73290-db61-4d39-bd2d-a65b0b1949a9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.789442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43946c-57e2-4cdb-93e2-02602baf3a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.790708 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43946c-57e2-4cdb-93e2-02602baf3a11 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.791001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43946c-57e2-4cdb-93e2-02602baf3a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.791279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43946c-57e2-4cdb-93e2-02602baf3a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.792010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43946c-57e2-4cdb-93e2-02602baf3a11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:37.792308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43946c-57e2-4cdb-93e2-02602baf3a11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.817634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43946c-57e2-4cdb-93e2-02602baf3a11 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.831287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 602/1203] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:01:37.839752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df610728-d5df-48b5-9c61-152b38ed4e09 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:37.851578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df610728-d5df-48b5-9c61-152b38ed4e09 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:37.856718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991f198-85bd-47ed-aec7-92f801b0d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:37.857323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f198-85bd-47ed-aec7-92f801b0d390 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:37.857611 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f198-85bd-47ed-aec7-92f801b0d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:37.857896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f198-85bd-47ed-aec7-92f801b0d390 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:37.858984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991f198-85bd-47ed-aec7-92f801b0d390 admin admin] RBAC: Adding query filter params (role.id=61b5c8d35a4340cc8763596e0d938bf0, scope.project.id=0dd358f713924c24991a83b329dfcb8e, user.id=78404f52618b4d86a2a478f18b136773) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:37.859288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991f198-85bd-47ed-aec7-92f801b0d390 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:37.885065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991f198-85bd-47ed-aec7-92f801b0d390 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:37.891435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 602/1204] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Oct 27 14:01:37 2021] GET /identity/v3/role_assignments?user.id=78404f52618b4d86a2a478f18b136773&scope.project.id=0dd358f713924c24991a83b329dfcb8e&role.id=61b5c8d35a4340cc8763596e0d938bf0 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:39.920347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1a48-224e-48fe-a588-5ee12668cefe None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:39.920896 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1a48-224e-48fe-a588-5ee12668cefe None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:39.920987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1a48-224e-48fe-a588-5ee12668cefe None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:39.922591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 603/1205] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:39.927903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f761e57-eee5-426f-92f5-46c6c1471313 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:39.928349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f761e57-eee5-426f-92f5-46c6c1471313 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:39.928470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f761e57-eee5-426f-92f5-46c6c1471313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:39.952779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-5f761e57-eee5-426f-92f5-46c6c1471313 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:39.953898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5f761e57-eee5-426f-92f5-46c6c1471313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:39.963414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 603/1206] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:39 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:01:39.986862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c1a48-224e-48fe-a588-5ee12668cefe None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:39.998959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c1a48-224e-48fe-a588-5ee12668cefe None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:40.002980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c66276-fa5e-4fb8-9e50-acb4e28de333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:40.003700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c66276-fa5e-4fb8-9e50-acb4e28de333 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:40.003984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c66276-fa5e-4fb8-9e50-acb4e28de333 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:40.004267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c66276-fa5e-4fb8-9e50-acb4e28de333 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:40.004887 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c66276-fa5e-4fb8-9e50-acb4e28de333 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:40.031069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c66276-fa5e-4fb8-9e50-acb4e28de333 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:40.042453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-93c66276-fa5e-4fb8-9e50-acb4e28de333 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 14:01:40.043551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 604/1207] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 14:01:39 2021] GET /identity/v3/services/placement => generated 90 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:40.049607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f761e57-eee5-426f-92f5-46c6c1471313 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:40.058212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f761e57-eee5-426f-92f5-46c6c1471313 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:40.062351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dac27d-c2f9-4859-a06f-30c99bca6b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:40.063055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dac27d-c2f9-4859-a06f-30c99bca6b74 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:40.063271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dac27d-c2f9-4859-a06f-30c99bca6b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:40.063555 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dac27d-c2f9-4859-a06f-30c99bca6b74 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:40.064225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dac27d-c2f9-4859-a06f-30c99bca6b74 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:40.064527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dac27d-c2f9-4859-a06f-30c99bca6b74 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:40.090350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dac27d-c2f9-4859-a06f-30c99bca6b74 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:40.095511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 604/1208] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Oct 27 14:01:40 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:40.101264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c66276-fa5e-4fb8-9e50-acb4e28de333 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:40.111444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c66276-fa5e-4fb8-9e50-acb4e28de333 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:40.115555 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06bc50-e473-4f48-8a81-97f445084fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:40.116139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06bc50-e473-4f48-8a81-97f445084fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:40.116431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06bc50-e473-4f48-8a81-97f445084fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:40.116747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06bc50-e473-4f48-8a81-97f445084fe2 admin admin] PATH_INFO: `/v3/services` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:40.117382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06bc50-e473-4f48-8a81-97f445084fe2 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:40.117765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06bc50-e473-4f48-8a81-97f445084fe2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:40.142915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06bc50-e473-4f48-8a81-97f445084fe2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:40.147235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 605/1209] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Oct 27 14:01:40 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:42.154314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d87d2-8db5-4115-a44a-ba9fb459bc39 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:42.154914 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d87d2-8db5-4115-a44a-ba9fb459bc39 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:42.154914 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d87d2-8db5-4115-a44a-ba9fb459bc39 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:42.156543 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 605/1210] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:42.161597 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8b6b-2246-41e0-be56-361e483edd5c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:42.162021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8b6b-2246-41e0-be56-361e483edd5c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:42.162178 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8b6b-2246-41e0-be56-361e483edd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:42.184715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e33d8b6b-2246-41e0-be56-361e483edd5c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:42.185850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e33d8b6b-2246-41e0-be56-361e483edd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:42.192654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 606/1211] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:01:42.214673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d87d2-8db5-4115-a44a-ba9fb459bc39 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:42.226115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d87d2-8db5-4115-a44a-ba9fb459bc39 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:42.230670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65b09e-d8e8-4bc4-82b2-b8381560c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:42.231255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65b09e-d8e8-4bc4-82b2-b8381560c3ba admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:42.231542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65b09e-d8e8-4bc4-82b2-b8381560c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:42.231822 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65b09e-d8e8-4bc4-82b2-b8381560c3ba admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:42.232481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65b09e-d8e8-4bc4-82b2-b8381560c3ba admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:42.258745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65b09e-d8e8-4bc4-82b2-b8381560c3ba admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:42.272458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 606/1212] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 27 14:01:42 2021] POST /identity/v3/services => generated 246 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:01:44.271368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2c9b-cc46-43f5-89eb-1f44902876d6 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:44.271891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2c9b-cc46-43f5-89eb-1f44902876d6 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:44.271891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2c9b-cc46-43f5-89eb-1f44902876d6 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:44.273522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 607/1213] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:44.278683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e82aa-e13a-46fa-b710-c2c0fab6db26 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:44.279125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e82aa-e13a-46fa-b710-c2c0fab6db26 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:44.279266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e82aa-e13a-46fa-b710-c2c0fab6db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:44.301701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-cc7e82aa-e13a-46fa-b710-c2c0fab6db26 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:44.302851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-cc7e82aa-e13a-46fa-b710-c2c0fab6db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:44.320593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 607/1214] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:44 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:01:44.341839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df2c9b-cc46-43f5-89eb-1f44902876d6 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:44.354035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df2c9b-cc46-43f5-89eb-1f44902876d6 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:44.358053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329d588-a5fe-48fe-b934-fe572afb13a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:44.359040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329d588-a5fe-48fe-b934-fe572afb13a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:44.359328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329d588-a5fe-48fe-b934-fe572afb13a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:44.359611 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329d588-a5fe-48fe-b934-fe572afb13a6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:44.360224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329d588-a5fe-48fe-b934-fe572afb13a6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:44.385631 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329d588-a5fe-48fe-b934-fe572afb13a6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:44.395822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-a329d588-a5fe-48fe-b934-fe572afb13a6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 14:01:44.396866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 608/1215] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 14:01:44 2021] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:44.403341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e82aa-e13a-46fa-b710-c2c0fab6db26 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:44.412067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e82aa-e13a-46fa-b710-c2c0fab6db26 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:44.416967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810b6e-f04b-4b17-8941-3bf86911f91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:44.417558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810b6e-f04b-4b17-8941-3bf86911f91e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:44.417847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810b6e-f04b-4b17-8941-3bf86911f91e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:44.418131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810b6e-f04b-4b17-8941-3bf86911f91e admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:44.418841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3810b6e-f04b-4b17-8941-3bf86911f91e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:44.419141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3810b6e-f04b-4b17-8941-3bf86911f91e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:44.444733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3810b6e-f04b-4b17-8941-3bf86911f91e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:44.450321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 608/1216] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Oct 27 14:01:44 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:01:44.456355 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329d588-a5fe-48fe-b934-fe572afb13a6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:44.466325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329d588-a5fe-48fe-b934-fe572afb13a6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:44.470595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8d216-5efc-47b5-b843-3843f4ef3c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:44.471208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d216-5efc-47b5-b843-3843f4ef3c19 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:44.471501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d216-5efc-47b5-b843-3843f4ef3c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:44.471787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d216-5efc-47b5-b843-3843f4ef3c19 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:44.472527 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8d216-5efc-47b5-b843-3843f4ef3c19 admin admin] RBAC: Adding query filter params (interface=public, service_id=9cb0b83d4cdf497b8675c4c8c576e73e, region_id=RegionOne) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:44.472834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8d216-5efc-47b5-b843-3843f4ef3c19 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:44.498636 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8d216-5efc-47b5-b843-3843f4ef3c19 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:44.504073 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 609/1217] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Oct 27 14:01:44 2021] GET /identity/v3/endpoints?service_id=9cb0b83d4cdf497b8675c4c8c576e73e&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:44.509926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810b6e-f04b-4b17-8941-3bf86911f91e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:44.519151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810b6e-f04b-4b17-8941-3bf86911f91e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:44.523397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c469f-2cd0-4f58-96f0-5956c1abd663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:44.524402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c469f-2cd0-4f58-96f0-5956c1abd663 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:44.524883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c469f-2cd0-4f58-96f0-5956c1abd663 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:44.525280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c469f-2cd0-4f58-96f0-5956c1abd663 admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:44.525923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c469f-2cd0-4f58-96f0-5956c1abd663 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:44.551653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c469f-2cd0-4f58-96f0-5956c1abd663 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:44.559005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 609/1218] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 14:01:44 2021] GET /identity/v3/services => generated 2430 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:01:46.553247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1764-c42f-4b89-9569-adea424d479c None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:46.553830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1764-c42f-4b89-9569-adea424d479c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:46.553830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1764-c42f-4b89-9569-adea424d479c None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:46.555756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 610/1219] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:01:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:01:46.560879 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cad0a7-cd3a-4028-a58a-9ffc7d1d6c5b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:46.561316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cad0a7-cd3a-4028-a58a-9ffc7d1d6c5b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:46.561455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cad0a7-cd3a-4028-a58a-9ffc7d1d6c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:46.584161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-73cad0a7-cd3a-4028-a58a-9ffc7d1d6c5b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:01:46.585296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-73cad0a7-cd3a-4028-a58a-9ffc7d1d6c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:01:46.592750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 610/1220] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:01:46 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:01:46.614791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1764-c42f-4b89-9569-adea424d479c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:46.626423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1764-c42f-4b89-9569-adea424d479c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:46.630431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92a95d-d6df-49fc-a889-2b3fc0384c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:46.631183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a95d-d6df-49fc-a889-2b3fc0384c0d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:46.631471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a95d-d6df-49fc-a889-2b3fc0384c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:46.631782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a95d-d6df-49fc-a889-2b3fc0384c0d admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:46.632401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92a95d-d6df-49fc-a889-2b3fc0384c0d admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:46.658415 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92a95d-d6df-49fc-a889-2b3fc0384c0d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:46.668552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING keystone.server.flask.application [None req-7e92a95d-d6df-49fc-a889-2b3fc0384c0d admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 14:01:46.669613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 611/1221] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Oct 27 14:01:46 2021] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:01:46.675443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cad0a7-cd3a-4028-a58a-9ffc7d1d6c5b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:46.684561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cad0a7-cd3a-4028-a58a-9ffc7d1d6c5b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:46.688698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361bbc5-6038-4be4-bc32-194057ce4a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:46.689290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361bbc5-6038-4be4-bc32-194057ce4a9e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:46.689578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361bbc5-6038-4be4-bc32-194057ce4a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:46.689865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361bbc5-6038-4be4-bc32-194057ce4a9e admin admin] PATH_INFO: `/v3/services` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:46.690537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361bbc5-6038-4be4-bc32-194057ce4a9e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:01:46.690865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361bbc5-6038-4be4-bc32-194057ce4a9e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:46.716651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361bbc5-6038-4be4-bc32-194057ce4a9e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:46.721839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 611/1222] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Oct 27 14:01:46 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:01:46.727514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92a95d-d6df-49fc-a889-2b3fc0384c0d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:01:46.737887 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92a95d-d6df-49fc-a889-2b3fc0384c0d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:01:46.741933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6f156-7017-4001-a556-1d7c42045c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:01:46.743047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6f156-7017-4001-a556-1d7c42045c19 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:01:46.743434 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6f156-7017-4001-a556-1d7c42045c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:01:46.743738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6f156-7017-4001-a556-1d7c42045c19 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:01:46.744486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6f156-7017-4001-a556-1d7c42045c19 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:01:46.769918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6f156-7017-4001-a556-1d7c42045c19 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:01:46.787426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 612/1223] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Oct 27 14:01:46 2021] POST /identity/v3/endpoints => generated 331 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:03:30.230861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec3bd-e3e4-4b73-ad82-8a4f7856159b None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:30.231463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec3bd-e3e4-4b73-ad82-8a4f7856159b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:30.231463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec3bd-e3e4-4b73-ad82-8a4f7856159b None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:30.233093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 612/1224] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:30.239006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003e65-329a-4d24-a2f4-f02842d884fd None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:30.239486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003e65-329a-4d24-a2f4-f02842d884fd None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:30.239581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003e65-329a-4d24-a2f4-f02842d884fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:30.326419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ae003e65-329a-4d24-a2f4-f02842d884fd None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:30.327581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ae003e65-329a-4d24-a2f4-f02842d884fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:30.439558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 613/1225] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:30.461968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fec3bd-e3e4-4b73-ad82-8a4f7856159b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:30.463837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-68fec3bd-e3e4-4b73-ad82-8a4f7856159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:30.612022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fec3bd-e3e4-4b73-ad82-8a4f7856159b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:30.715733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c22c5-123a-4c1a-b7c7-e8bed5c588ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:30.716432 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c22c5-123a-4c1a-b7c7-e8bed5c588ff admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:30.716724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c22c5-123a-4c1a-b7c7-e8bed5c588ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:30.717011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c22c5-123a-4c1a-b7c7-e8bed5c588ff admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:30.717698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c22c5-123a-4c1a-b7c7-e8bed5c588ff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:30.743854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c22c5-123a-4c1a-b7c7-e8bed5c588ff admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:30.760986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 613/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 14:03:30 2021] GET /identity/v3/projects => generated 2553 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:03:32.817717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea75b-2b3f-4b9f-9313-2f560ed88ba0 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:32.818259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea75b-2b3f-4b9f-9313-2f560ed88ba0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:32.818346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aea75b-2b3f-4b9f-9313-2f560ed88ba0 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:32.820020 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 614/1227] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:32.825334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8dce-fe7e-499b-bc65-9ba02f7038bd None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:32.825789 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8dce-fe7e-499b-bc65-9ba02f7038bd None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:32.825913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8dce-fe7e-499b-bc65-9ba02f7038bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:32.914098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3e6c8dce-fe7e-499b-bc65-9ba02f7038bd None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:32.915298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3e6c8dce-fe7e-499b-bc65-9ba02f7038bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:33.025330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 614/1228] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:33.073503 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581ac26-c485-496d-bcc2-e0690e8d0d96 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:33.073722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581ac26-c485-496d-bcc2-e0690e8d0d96 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:33.074008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581ac26-c485-496d-bcc2-e0690e8d0d96 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:33.075699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 615/1229] 10.222.0.36 () {54 vars in 963 bytes} [Wed Oct 27 14:03:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:33.082026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521ebb-6b84-4afc-bf0e-b303060d28fe None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:33.082323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521ebb-6b84-4afc-bf0e-b303060d28fe None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:33.082612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521ebb-6b84-4afc-bf0e-b303060d28fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:33.178004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-06521ebb-6b84-4afc-bf0e-b303060d28fe None None] MFA Rules not processed for user `dea5ec2125f0468baa1e15a429021e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:33.179175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-06521ebb-6b84-4afc-bf0e-b303060d28fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:33.264746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 615/1230] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Oct 27 14:03:33 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:33.274183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581ac26-c485-496d-bcc2-e0690e8d0d96 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:33.275647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1581ac26-c485-496d-bcc2-e0690e8d0d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:33.395836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581ac26-c485-496d-bcc2-e0690e8d0d96 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:33.479712 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28113c64-3e78-40ef-89b6-c93fa94d12d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:33.480293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28113c64-3e78-40ef-89b6-c93fa94d12d7 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:33.480587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28113c64-3e78-40ef-89b6-c93fa94d12d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:33.480873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28113c64-3e78-40ef-89b6-c93fa94d12d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:33.482410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-28113c64-3e78-40ef-89b6-c93fa94d12d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:33.606089 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28113c64-3e78-40ef-89b6-c93fa94d12d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:33.631551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28113c64-3e78-40ef-89b6-c93fa94d12d7 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:33.653654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 616/1231] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:03:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:03:35.936954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc4736-b3de-43e8-a015-77322d69bc3f None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:35.937472 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc4736-b3de-43e8-a015-77322d69bc3f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:35.937662 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc4736-b3de-43e8-a015-77322d69bc3f None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:35.939931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 616/1232] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:35.945171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a7767-7f07-4a76-8258-d1bd5db8fcc5 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:35.945595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a7767-7f07-4a76-8258-d1bd5db8fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:35.945730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a7767-7f07-4a76-8258-d1bd5db8fcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:36.031813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ef2a7767-7f07-4a76-8258-d1bd5db8fcc5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:36.032960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ef2a7767-7f07-4a76-8258-d1bd5db8fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:36.137091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 617/1233] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:36.188078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83d92-3a85-4372-a13d-1e70bca59c8c None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:36.188370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83d92-3a85-4372-a13d-1e70bca59c8c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:36.188654 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83d92-3a85-4372-a13d-1e70bca59c8c None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:36.190324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 617/1234] 10.222.0.36 () {54 vars in 963 bytes} [Wed Oct 27 14:03:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:36.196114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59358c78-ce0d-4936-9409-63ee663b2e34 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:36.196422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59358c78-ce0d-4936-9409-63ee663b2e34 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:36.196715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59358c78-ce0d-4936-9409-63ee663b2e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:36.298933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-59358c78-ce0d-4936-9409-63ee663b2e34 None None] MFA Rules not processed for user `dea5ec2125f0468baa1e15a429021e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:36.300077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-59358c78-ce0d-4936-9409-63ee663b2e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:36.385559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 618/1235] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Oct 27 14:03:36 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:36.394897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf83d92-3a85-4372-a13d-1e70bca59c8c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:36.396285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7cf83d92-3a85-4372-a13d-1e70bca59c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:36.515380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf83d92-3a85-4372-a13d-1e70bca59c8c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:36.598461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e670f6c-2a3d-4479-9c9f-f48e13f018eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:36.599077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e670f6c-2a3d-4479-9c9f-f48e13f018eb service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:36.599371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e670f6c-2a3d-4479-9c9f-f48e13f018eb service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:36.599664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e670f6c-2a3d-4479-9c9f-f48e13f018eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:36.601201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8e670f6c-2a3d-4479-9c9f-f48e13f018eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:36.724157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e670f6c-2a3d-4479-9c9f-f48e13f018eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:36.749501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e670f6c-2a3d-4479-9c9f-f48e13f018eb service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:36.770032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 618/1236] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:03:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:03:39.221268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34f701-1671-494e-9466-1c3079e608e9 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:39.221814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34f701-1671-494e-9466-1c3079e608e9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:39.221814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34f701-1671-494e-9466-1c3079e608e9 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:39.223533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 619/1237] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:39.228917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79454d-c30e-4901-85df-4721ea763bec None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:39.229311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79454d-c30e-4901-85df-4721ea763bec None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:39.229480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79454d-c30e-4901-85df-4721ea763bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:39.313874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0d79454d-c30e-4901-85df-4721ea763bec None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:39.315047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0d79454d-c30e-4901-85df-4721ea763bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:39.418640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 619/1238] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:39.452459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34f701-1671-494e-9466-1c3079e608e9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:39.454444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6f34f701-1671-494e-9466-1c3079e608e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:39.593332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34f701-1671-494e-9466-1c3079e608e9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:39.696086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b91c11-47fe-4212-89a2-22117c4201a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:39.696910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b91c11-47fe-4212-89a2-22117c4201a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:39.697200 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b91c11-47fe-4212-89a2-22117c4201a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:39.697485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b91c11-47fe-4212-89a2-22117c4201a8 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:39.708307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b91c11-47fe-4212-89a2-22117c4201a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:39.734135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b91c11-47fe-4212-89a2-22117c4201a8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:39.736686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 620/1239] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:03:39 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:03:39.748961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79454d-c30e-4901-85df-4721ea763bec None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:39.750689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0d79454d-c30e-4901-85df-4721ea763bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:39.865560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79454d-c30e-4901-85df-4721ea763bec None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:39.949296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb44f1e-26c5-429e-b4c7-e6cf344802f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:39.949930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb44f1e-26c5-429e-b4c7-e6cf344802f3 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:39.950166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb44f1e-26c5-429e-b4c7-e6cf344802f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:39.950448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb44f1e-26c5-429e-b4c7-e6cf344802f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:39.951987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-bbb44f1e-26c5-429e-b4c7-e6cf344802f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:40.076682 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb44f1e-26c5-429e-b4c7-e6cf344802f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:40.102296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb44f1e-26c5-429e-b4c7-e6cf344802f3 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:40.122827 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 620/1240] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:03:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:03:42.687313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74224bf6-5936-4b01-a9c9-704749e7520f None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:42.688426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74224bf6-5936-4b01-a9c9-704749e7520f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:42.688543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74224bf6-5936-4b01-a9c9-704749e7520f None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:42.690227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 621/1241] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:42.695399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78bee8-19de-4f9a-b814-df78cf476448 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:42.695789 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78bee8-19de-4f9a-b814-df78cf476448 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:42.695968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78bee8-19de-4f9a-b814-df78cf476448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:42.784916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1e78bee8-19de-4f9a-b814-df78cf476448 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:42.786066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1e78bee8-19de-4f9a-b814-df78cf476448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:42.890962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 621/1242] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:42.924227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74224bf6-5936-4b01-a9c9-704749e7520f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:42.925674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-74224bf6-5936-4b01-a9c9-704749e7520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:43.078411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74224bf6-5936-4b01-a9c9-704749e7520f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:43.190875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321ca09-26f6-467f-bec2-b5984827d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:43.191663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321ca09-26f6-467f-bec2-b5984827d68a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:43.191957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321ca09-26f6-467f-bec2-b5984827d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:43.192234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321ca09-26f6-467f-bec2-b5984827d68a admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:43.202988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321ca09-26f6-467f-bec2-b5984827d68a admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:43.230260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321ca09-26f6-467f-bec2-b5984827d68a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:43.231874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 622/1243] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:03:42 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:03:43.244094 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78bee8-19de-4f9a-b814-df78cf476448 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:43.245211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1e78bee8-19de-4f9a-b814-df78cf476448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:43.351305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78bee8-19de-4f9a-b814-df78cf476448 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:43.434051 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833aafb-28ea-4b20-9cd4-fd07d0d245f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:43.434646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833aafb-28ea-4b20-9cd4-fd07d0d245f7 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:43.434958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833aafb-28ea-4b20-9cd4-fd07d0d245f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:43.435243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833aafb-28ea-4b20-9cd4-fd07d0d245f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:43.436785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0833aafb-28ea-4b20-9cd4-fd07d0d245f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:43.568700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833aafb-28ea-4b20-9cd4-fd07d0d245f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:43.594954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833aafb-28ea-4b20-9cd4-fd07d0d245f7 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:43.617104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 622/1244] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:03:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:03:46.491693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302539fb-aa5f-42ad-870b-7a243c30f6b0 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:46.492330 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302539fb-aa5f-42ad-870b-7a243c30f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:46.492330 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302539fb-aa5f-42ad-870b-7a243c30f6b0 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:46.493971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 623/1245] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:46.499587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90313d2a-6d4e-4c7d-a445-5b4535d5d916 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:46.500645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90313d2a-6d4e-4c7d-a445-5b4535d5d916 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:46.501152 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90313d2a-6d4e-4c7d-a445-5b4535d5d916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:46.593236 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-90313d2a-6d4e-4c7d-a445-5b4535d5d916 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:46.595049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-90313d2a-6d4e-4c7d-a445-5b4535d5d916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:46.715154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 623/1246] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:46.762589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302539fb-aa5f-42ad-870b-7a243c30f6b0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:46.764113 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-302539fb-aa5f-42ad-870b-7a243c30f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:46.891171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302539fb-aa5f-42ad-870b-7a243c30f6b0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:46.977082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4af31-5d4a-4cd1-a3f2-bff577de6ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:46.977680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4af31-5d4a-4cd1-a3f2-bff577de6ddb service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:46.977973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4af31-5d4a-4cd1-a3f2-bff577de6ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:46.978260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4af31-5d4a-4cd1-a3f2-bff577de6ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:46.979833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1ed4af31-5d4a-4cd1-a3f2-bff577de6ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:47.108046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4af31-5d4a-4cd1-a3f2-bff577de6ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:47.133394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4af31-5d4a-4cd1-a3f2-bff577de6ddb service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:47.155741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 624/1247] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:03:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:03:49.220820 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e88b0-3084-4219-a9e6-3140edb10e4e None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:49.221346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e88b0-3084-4219-a9e6-3140edb10e4e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:49.221346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e88b0-3084-4219-a9e6-3140edb10e4e None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:49.223055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 624/1248] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:49.228615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438df4a1-28c0-4699-9bc8-396c7ba6cb6c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:49.229066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438df4a1-28c0-4699-9bc8-396c7ba6cb6c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:49.229170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438df4a1-28c0-4699-9bc8-396c7ba6cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:49.320715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-438df4a1-28c0-4699-9bc8-396c7ba6cb6c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:49.321912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-438df4a1-28c0-4699-9bc8-396c7ba6cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:49.439503 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 625/1249] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:49.474905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e88b0-3084-4219-a9e6-3140edb10e4e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:49.476591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-372e88b0-3084-4219-a9e6-3140edb10e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:49.605824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e88b0-3084-4219-a9e6-3140edb10e4e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:49.694134 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14497de-4adc-457e-bd3d-5dd575040165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:49.694753 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14497de-4adc-457e-bd3d-5dd575040165 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:49.695043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14497de-4adc-457e-bd3d-5dd575040165 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:49.695380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14497de-4adc-457e-bd3d-5dd575040165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:49.697453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e14497de-4adc-457e-bd3d-5dd575040165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:49.834160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14497de-4adc-457e-bd3d-5dd575040165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:49.863027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14497de-4adc-457e-bd3d-5dd575040165 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:49.887471 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 625/1250] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:03:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:03:51.938082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccef1-bfa2-4294-babd-e29852921c7c None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:51.938616 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccef1-bfa2-4294-babd-e29852921c7c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:51.938736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccef1-bfa2-4294-babd-e29852921c7c None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:51.940330 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 626/1251] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:51.945513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941c7c-328d-444a-9bfa-0f5d2bedb63f None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:51.945934 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941c7c-328d-444a-9bfa-0f5d2bedb63f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:51.946092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6941c7c-328d-444a-9bfa-0f5d2bedb63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:52.035145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-f6941c7c-328d-444a-9bfa-0f5d2bedb63f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:52.036324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f6941c7c-328d-444a-9bfa-0f5d2bedb63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:52.140607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 626/1252] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:52.172902 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccef1-bfa2-4294-babd-e29852921c7c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:52.174309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-163ccef1-bfa2-4294-babd-e29852921c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:52.314352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccef1-bfa2-4294-babd-e29852921c7c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:52.417865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732893a-647d-43e7-96a7-86518f268e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:52.418682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732893a-647d-43e7-96a7-86518f268e47 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:52.418978 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732893a-647d-43e7-96a7-86518f268e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:52.419264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732893a-647d-43e7-96a7-86518f268e47 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:52.430262 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732893a-647d-43e7-96a7-86518f268e47 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:52.456836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732893a-647d-43e7-96a7-86518f268e47 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:52.458421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 627/1253] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:03:52 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:03:52.471449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941c7c-328d-444a-9bfa-0f5d2bedb63f None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:52.472598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f6941c7c-328d-444a-9bfa-0f5d2bedb63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:52.577440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6941c7c-328d-444a-9bfa-0f5d2bedb63f None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:52.745890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa06328-3a59-4842-be0b-a41930ce33d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:52.746480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa06328-3a59-4842-be0b-a41930ce33d3 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:52.746808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa06328-3a59-4842-be0b-a41930ce33d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:52.747094 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa06328-3a59-4842-be0b-a41930ce33d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:52.748640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-bfa06328-3a59-4842-be0b-a41930ce33d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:52.874459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa06328-3a59-4842-be0b-a41930ce33d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:52.901095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa06328-3a59-4842-be0b-a41930ce33d3 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:52.921450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 627/1254] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:03:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:03:55.137906 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052535-0e83-4686-ab64-4bf1787c38a3 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:55.138434 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052535-0e83-4686-ab64-4bf1787c38a3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:55.138554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052535-0e83-4686-ab64-4bf1787c38a3 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:55.140159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 628/1255] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:55.145980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c460d-a9ff-45b1-b30a-845cf502cac1 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:55.146400 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c460d-a9ff-45b1-b30a-845cf502cac1 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:55.146561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c460d-a9ff-45b1-b30a-845cf502cac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:55.230703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-f66c460d-a9ff-45b1-b30a-845cf502cac1 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:55.231869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f66c460d-a9ff-45b1-b30a-845cf502cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:55.345497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 628/1256] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:03:55.381989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052535-0e83-4686-ab64-4bf1787c38a3 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:55.383511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1a052535-0e83-4686-ab64-4bf1787c38a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:55.502306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052535-0e83-4686-ab64-4bf1787c38a3 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:55.586346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd4c1d-ef4e-4ed5-8711-f2ec2e883db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:55.586840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4c1d-ef4e-4ed5-8711-f2ec2e883db1 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:55.587128 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4c1d-ef4e-4ed5-8711-f2ec2e883db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:55.587407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4c1d-ef4e-4ed5-8711-f2ec2e883db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:55.588941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-04fd4c1d-ef4e-4ed5-8711-f2ec2e883db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:55.713267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd4c1d-ef4e-4ed5-8711-f2ec2e883db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:55.740006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd4c1d-ef4e-4ed5-8711-f2ec2e883db1 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:55.759992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 629/1257] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:03:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:03:57.820018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0ee41-ecf1-4d9b-93f7-26a3ea08e0a9 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:57.820580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0ee41-ecf1-4d9b-93f7-26a3ea08e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:57.820580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0ee41-ecf1-4d9b-93f7-26a3ea08e0a9 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:57.822352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 629/1258] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:03:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:03:57.827974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4902f86-9d9d-46fc-8435-48c43b0a6757 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:57.828422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4902f86-9d9d-46fc-8435-48c43b0a6757 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:57.828558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4902f86-9d9d-46fc-8435-48c43b0a6757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:58.000009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e4902f86-9d9d-46fc-8435-48c43b0a6757 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:03:58.001317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e4902f86-9d9d-46fc-8435-48c43b0a6757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:58.106030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 630/1259] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:03:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:03:58.145542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0ee41-ecf1-4d9b-93f7-26a3ea08e0a9 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:03:58.147057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5cc0ee41-ecf1-4d9b-93f7-26a3ea08e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:58.267013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0ee41-ecf1-4d9b-93f7-26a3ea08e0a9 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:03:58.351309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d4a40-6651-4b08-bf57-aaee5d92a7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:03:58.351609 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d4a40-6651-4b08-bf57-aaee5d92a7fa service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:03:58.352045 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d4a40-6651-4b08-bf57-aaee5d92a7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:03:58.352376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d4a40-6651-4b08-bf57-aaee5d92a7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:03:58.354128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6c5d4a40-6651-4b08-bf57-aaee5d92a7fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:03:58.486921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d4a40-6651-4b08-bf57-aaee5d92a7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:03:58.511716 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d4a40-6651-4b08-bf57-aaee5d92a7fa service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:03:58.533078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 630/1260] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:03:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:00.994507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c529e0-dfa7-4c43-8d5e-cd3eab40a0c1 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:00.995107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c529e0-dfa7-4c43-8d5e-cd3eab40a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:00.995107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c529e0-dfa7-4c43-8d5e-cd3eab40a0c1 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:00.996814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 631/1261] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:01.002475 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0dc5-e5e3-4948-8efb-0e3b9af570e6 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:01.002911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0dc5-e5e3-4948-8efb-0e3b9af570e6 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:01.003211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0dc5-e5e3-4948-8efb-0e3b9af570e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:01.094044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-b1cc0dc5-e5e3-4948-8efb-0e3b9af570e6 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:01.095335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b1cc0dc5-e5e3-4948-8efb-0e3b9af570e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:01.212731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 631/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:01.249766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c529e0-dfa7-4c43-8d5e-cd3eab40a0c1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:01.251904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d4c529e0-dfa7-4c43-8d5e-cd3eab40a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:01.363705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c529e0-dfa7-4c43-8d5e-cd3eab40a0c1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:01.366950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099fa50-fdc2-4e55-9c76-1075bf138960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:01.367526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099fa50-fdc2-4e55-9c76-1075bf138960 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:01.367813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099fa50-fdc2-4e55-9c76-1075bf138960 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:01.368093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099fa50-fdc2-4e55-9c76-1075bf138960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:01.377007 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099fa50-fdc2-4e55-9c76-1075bf138960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:01.402452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099fa50-fdc2-4e55-9c76-1075bf138960 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:01.412157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 632/1263] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:05.838060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f06e-b987-45ad-a39e-5fb423e7aad1 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:05.838756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f06e-b987-45ad-a39e-5fb423e7aad1 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:05.838756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f06e-b987-45ad-a39e-5fb423e7aad1 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:05.840330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 632/1264] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:05.845739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352bb36-9ff2-4076-b029-156166089ad0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:05.846166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352bb36-9ff2-4076-b029-156166089ad0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:05.846313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352bb36-9ff2-4076-b029-156166089ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:05.869827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-8352bb36-9ff2-4076-b029-156166089ad0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:05.870999 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8352bb36-9ff2-4076-b029-156166089ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:05.878523 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 633/1265] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:04:05.916985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f06e-b987-45ad-a39e-5fb423e7aad1 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:05.928925 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f06e-b987-45ad-a39e-5fb423e7aad1 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:05.932148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d44adf-22c3-4e06-94d8-ec27bf5895ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:05.932724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d44adf-22c3-4e06-94d8-ec27bf5895ad service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:05.933010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d44adf-22c3-4e06-94d8-ec27bf5895ad service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:05.933289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d44adf-22c3-4e06-94d8-ec27bf5895ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:05.942818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d44adf-22c3-4e06-94d8-ec27bf5895ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:05.968016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d44adf-22c3-4e06-94d8-ec27bf5895ad service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:05.980060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 633/1266] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:08.813567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2276b-2457-4433-8030-1f9135a01174 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:08.814220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2276b-2457-4433-8030-1f9135a01174 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:08.814220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2276b-2457-4433-8030-1f9135a01174 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:08.815912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 634/1267] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:08.821621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aa1e9-cf4e-4e4a-933e-e666a38b9cef None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:08.822078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aa1e9-cf4e-4e4a-933e-e666a38b9cef None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:08.822198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041aa1e9-cf4e-4e4a-933e-e666a38b9cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:08.846401 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-041aa1e9-cf4e-4e4a-933e-e666a38b9cef None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:08.847567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-041aa1e9-cf4e-4e4a-933e-e666a38b9cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:08.854462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 634/1268] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:08.892387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2276b-2457-4433-8030-1f9135a01174 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:08.902734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2276b-2457-4433-8030-1f9135a01174 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:08.907293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f1a7-17ca-489d-b7f0-1d5513c54df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:08.907882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f1a7-17ca-489d-b7f0-1d5513c54df1 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:08.908173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f1a7-17ca-489d-b7f0-1d5513c54df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:08.908458 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f1a7-17ca-489d-b7f0-1d5513c54df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:08.917862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f1a7-17ca-489d-b7f0-1d5513c54df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:08.944017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f1a7-17ca-489d-b7f0-1d5513c54df1 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:08.954019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 635/1269] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:13.343353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13427-51af-483b-b42b-16c9cf60eff4 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:13.343895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13427-51af-483b-b42b-16c9cf60eff4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:13.345644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13427-51af-483b-b42b-16c9cf60eff4 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:13.347784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 635/1270] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:13.353408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752459d9-6c24-4241-8eea-84322e49fc5c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:13.353892 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752459d9-6c24-4241-8eea-84322e49fc5c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:13.354041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752459d9-6c24-4241-8eea-84322e49fc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:13.378853 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-752459d9-6c24-4241-8eea-84322e49fc5c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:13.380023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-752459d9-6c24-4241-8eea-84322e49fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:13.390690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 636/1271] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:13.426936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13427-51af-483b-b42b-16c9cf60eff4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:13.439298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13427-51af-483b-b42b-16c9cf60eff4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:13.443169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36501bec-2d42-432a-8fb4-5db399cc4ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:13.443858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36501bec-2d42-432a-8fb4-5db399cc4ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:13.444227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36501bec-2d42-432a-8fb4-5db399cc4ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:13.444583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36501bec-2d42-432a-8fb4-5db399cc4ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:13.456093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36501bec-2d42-432a-8fb4-5db399cc4ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:13.481759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36501bec-2d42-432a-8fb4-5db399cc4ba5 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:13.494087 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 636/1272] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:17.999249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949aa86-ffd7-49fc-a8f8-28f7c94dc794 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:18.001734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949aa86-ffd7-49fc-a8f8-28f7c94dc794 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:18.003038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949aa86-ffd7-49fc-a8f8-28f7c94dc794 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:18.005672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 637/1273] 10.222.0.36 () {54 vars in 921 bytes} [Wed Oct 27 14:04:17 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:18.010948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817040a7-5f12-41ad-9559-f0949ba3be0a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:18.011789 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817040a7-5f12-41ad-9559-f0949ba3be0a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:18.012225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817040a7-5f12-41ad-9559-f0949ba3be0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:18.115317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-817040a7-5f12-41ad-9559-f0949ba3be0a None None] MFA Rules not processed for user `78404f52618b4d86a2a478f18b136773`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:18.116475 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-817040a7-5f12-41ad-9559-f0949ba3be0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:18.210509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 637/1274] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Oct 27 14:04:18 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:18.586479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9776-db9e-4e63-9b2e-9fde753c2741 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:18.587193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9776-db9e-4e63-9b2e-9fde753c2741 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:18.587782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9776-db9e-4e63-9b2e-9fde753c2741 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:18.591383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 638/1275] 10.222.0.36 () {54 vars in 921 bytes} [Wed Oct 27 14:04:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:18.597894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f32d5-6a6f-44be-9690-e502e4163a02 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:18.598390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f32d5-6a6f-44be-9690-e502e4163a02 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:18.598908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f32d5-6a6f-44be-9690-e502e4163a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:18.623154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-4f9f32d5-6a6f-44be-9690-e502e4163a02 None None] MFA Rules not processed for user `78404f52618b4d86a2a478f18b136773`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:18.624737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4f9f32d5-6a6f-44be-9690-e502e4163a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:18.639396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 638/1276] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Oct 27 14:04:18 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:22.793968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfaa39-8837-4444-b64c-2ccbcdbab8c7 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:22.794543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfaa39-8837-4444-b64c-2ccbcdbab8c7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:22.794543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfaa39-8837-4444-b64c-2ccbcdbab8c7 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:22.797030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 639/1277] 10.222.0.36 () {54 vars in 921 bytes} [Wed Oct 27 14:04:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:22.802143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e3dd5-efb1-44d5-96be-a1102387d93b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:22.802700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e3dd5-efb1-44d5-96be-a1102387d93b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:22.802984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e3dd5-efb1-44d5-96be-a1102387d93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:22.826782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-854e3dd5-efb1-44d5-96be-a1102387d93b None None] MFA Rules not processed for user `78404f52618b4d86a2a478f18b136773`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:22.828469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-854e3dd5-efb1-44d5-96be-a1102387d93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:22.836202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 639/1278] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Oct 27 14:04:22 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:24.483856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61345bdd-223b-4af5-a5a3-3ec1043deaea None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:24.485014 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61345bdd-223b-4af5-a5a3-3ec1043deaea None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:24.485014 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61345bdd-223b-4af5-a5a3-3ec1043deaea None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:24.486503 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 640/1279] 10.222.0.36 () {54 vars in 921 bytes} [Wed Oct 27 14:04:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:24.491965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20704031-0bfc-4868-b7e2-8e9dfda560fd None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:24.492406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20704031-0bfc-4868-b7e2-8e9dfda560fd None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:24.492541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20704031-0bfc-4868-b7e2-8e9dfda560fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:24.516828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-20704031-0bfc-4868-b7e2-8e9dfda560fd None None] MFA Rules not processed for user `78404f52618b4d86a2a478f18b136773`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:24.518130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-20704031-0bfc-4868-b7e2-8e9dfda560fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:24.526486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 640/1280] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Oct 27 14:04:24 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:04:27.907024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8da0-6d0b-4b16-86b5-2f53f356397f None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:27.907616 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8da0-6d0b-4b16-86b5-2f53f356397f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:27.907616 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8da0-6d0b-4b16-86b5-2f53f356397f None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:27.909393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 641/1281] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:27.915404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af566d7-3d4b-4b7c-8952-2a1b6ece99b5 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:27.915880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af566d7-3d4b-4b7c-8952-2a1b6ece99b5 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:27.915996 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af566d7-3d4b-4b7c-8952-2a1b6ece99b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:27.938400 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-4af566d7-3d4b-4b7c-8952-2a1b6ece99b5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:27.939603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4af566d7-3d4b-4b7c-8952-2a1b6ece99b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:27.946328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 641/1282] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:28.035925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716bb0-6d8e-44be-abeb-58d08206f84b None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:28.036223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716bb0-6d8e-44be-abeb-58d08206f84b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:28.036514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716bb0-6d8e-44be-abeb-58d08206f84b None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:28.038167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 642/1283] 10.222.0.36 () {54 vars in 954 bytes} [Wed Oct 27 14:04:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:28.043435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0600-1899-4e8b-912e-4f3a6158bb5f None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:28.043738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0600-1899-4e8b-912e-4f3a6158bb5f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:28.044029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0600-1899-4e8b-912e-4f3a6158bb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:28.112847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-f26a0600-1899-4e8b-912e-4f3a6158bb5f None None] MFA Rules not processed for user `a523c35d222f464e9d4f78ae990e3a17`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:28.113983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f26a0600-1899-4e8b-912e-4f3a6158bb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:28.202946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 642/1284] 10.222.0.36 () {58 vars in 1051 bytes} [Wed Oct 27 14:04:28 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:28.211154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716bb0-6d8e-44be-abeb-58d08206f84b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:28.224895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716bb0-6d8e-44be-abeb-58d08206f84b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:28.229761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375280bf-0676-45fa-a498-403c22dc653f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:28.230332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375280bf-0676-45fa-a498-403c22dc653f service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:28.230644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375280bf-0676-45fa-a498-403c22dc653f service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:28.230943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375280bf-0676-45fa-a498-403c22dc653f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:28.239599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375280bf-0676-45fa-a498-403c22dc653f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:28.265410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375280bf-0676-45fa-a498-403c22dc653f service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:28.274825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 643/1285] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:30.452712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2ac3e-d7c3-4bc3-b1ca-4b401c2e59a1 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:30.453249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2ac3e-d7c3-4bc3-b1ca-4b401c2e59a1 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:30.453341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2ac3e-d7c3-4bc3-b1ca-4b401c2e59a1 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:30.455078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 643/1286] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:30.460409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f2d26-3a9c-4ffa-8844-6e7499c1456a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:30.460843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f2d26-3a9c-4ffa-8844-6e7499c1456a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:30.461032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f2d26-3a9c-4ffa-8844-6e7499c1456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:30.484944 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-358f2d26-3a9c-4ffa-8844-6e7499c1456a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:30.486088 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-358f2d26-3a9c-4ffa-8844-6e7499c1456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:30.493195 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 644/1287] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:30.584855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f264a-0c16-40c8-aec0-44563d97c8ae None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:30.585153 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f264a-0c16-40c8-aec0-44563d97c8ae None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:30.585446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f264a-0c16-40c8-aec0-44563d97c8ae None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:30.587172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 644/1288] 10.222.0.36 () {54 vars in 954 bytes} [Wed Oct 27 14:04:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:30.592253 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d205ab7-eb0d-4710-b24b-722144d5c0a1 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:30.592541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d205ab7-eb0d-4710-b24b-722144d5c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:30.592828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d205ab7-eb0d-4710-b24b-722144d5c0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:30.616013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-3d205ab7-eb0d-4710-b24b-722144d5c0a1 None None] MFA Rules not processed for user `a523c35d222f464e9d4f78ae990e3a17`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:30.617137 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3d205ab7-eb0d-4710-b24b-722144d5c0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:30.626590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 645/1289] 10.222.0.36 () {58 vars in 1051 bytes} [Wed Oct 27 14:04:30 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:30.636982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f264a-0c16-40c8-aec0-44563d97c8ae None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:30.650640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f264a-0c16-40c8-aec0-44563d97c8ae None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:30.655520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a4fd-2d19-431e-ac18-31b7b2188455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:30.656369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a4fd-2d19-431e-ac18-31b7b2188455 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:30.656687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a4fd-2d19-431e-ac18-31b7b2188455 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:30.656971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a4fd-2d19-431e-ac18-31b7b2188455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:30.664887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6a4fd-2d19-431e-ac18-31b7b2188455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:30.691677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6a4fd-2d19-431e-ac18-31b7b2188455 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:30.700796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 645/1290] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:32.994030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5c892-b88e-4e00-be5c-fab83c52fa1b None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:32.994588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5c892-b88e-4e00-be5c-fab83c52fa1b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:32.994588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5c892-b88e-4e00-be5c-fab83c52fa1b None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:32.996318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 646/1291] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:33.001661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219edde-320e-4103-ba15-e7b0880880a9 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:33.002066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219edde-320e-4103-ba15-e7b0880880a9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:33.002231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219edde-320e-4103-ba15-e7b0880880a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:33.025315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-e219edde-320e-4103-ba15-e7b0880880a9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:33.026456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e219edde-320e-4103-ba15-e7b0880880a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:33.034524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 646/1292] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:33.123067 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5c892-b88e-4e00-be5c-fab83c52fa1b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:33.136806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5c892-b88e-4e00-be5c-fab83c52fa1b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:33.142051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4ea44-b16f-491e-b99f-b61f2e18179c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:33.142617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4ea44-b16f-491e-b99f-b61f2e18179c service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:33.142927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4ea44-b16f-491e-b99f-b61f2e18179c service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:33.143207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4ea44-b16f-491e-b99f-b61f2e18179c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:33.151050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4ea44-b16f-491e-b99f-b61f2e18179c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:33.175900 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4ea44-b16f-491e-b99f-b61f2e18179c service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:33.184735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 647/1293] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:35.414169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073440a6-72db-4a23-ba95-9a393f023483 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:35.414718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073440a6-72db-4a23-ba95-9a393f023483 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:35.414841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073440a6-72db-4a23-ba95-9a393f023483 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:35.416451 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 647/1294] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:35.422390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae498f2-0da1-4f55-84f3-107949b078df None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:35.422844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae498f2-0da1-4f55-84f3-107949b078df None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:35.422985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae498f2-0da1-4f55-84f3-107949b078df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:35.445369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6ae498f2-0da1-4f55-84f3-107949b078df None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:35.446497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6ae498f2-0da1-4f55-84f3-107949b078df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:35.453530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 648/1295] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:35.541074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073440a6-72db-4a23-ba95-9a393f023483 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:35.554721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073440a6-72db-4a23-ba95-9a393f023483 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:35.559501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c822a-c36b-474e-8521-6ffe44464434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:35.560074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c822a-c36b-474e-8521-6ffe44464434 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:35.560363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c822a-c36b-474e-8521-6ffe44464434 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:35.560644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c822a-c36b-474e-8521-6ffe44464434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:35.568468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c822a-c36b-474e-8521-6ffe44464434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:35.594148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c822a-c36b-474e-8521-6ffe44464434 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:35.603136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 648/1296] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:37.816859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125134-eb71-432d-ab6e-e962511a2440 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:37.817403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125134-eb71-432d-ab6e-e962511a2440 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:37.817403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125134-eb71-432d-ab6e-e962511a2440 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:37.819177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 649/1297] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:37.824671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152863cd-72c7-4f98-ad69-6967c26017e1 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:37.825075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152863cd-72c7-4f98-ad69-6967c26017e1 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:37.825239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152863cd-72c7-4f98-ad69-6967c26017e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:37.848313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-152863cd-72c7-4f98-ad69-6967c26017e1 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:37.849436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-152863cd-72c7-4f98-ad69-6967c26017e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:37.856342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 649/1298] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:37.943535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125134-eb71-432d-ab6e-e962511a2440 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:37.956735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125134-eb71-432d-ab6e-e962511a2440 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:37.961496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10482601-57b1-4342-9320-bc73f3bc8dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:37.962060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10482601-57b1-4342-9320-bc73f3bc8dec service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:37.962347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10482601-57b1-4342-9320-bc73f3bc8dec service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:37.962647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10482601-57b1-4342-9320-bc73f3bc8dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:37.970552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10482601-57b1-4342-9320-bc73f3bc8dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:37.996836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10482601-57b1-4342-9320-bc73f3bc8dec service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:38.007004 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 650/1299] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:40.099519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c3bcd-6477-4327-bca5-1244334401e7 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:40.100053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c3bcd-6477-4327-bca5-1244334401e7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:40.100148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c3bcd-6477-4327-bca5-1244334401e7 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:40.101801 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 650/1300] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:40.107373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76df46-f684-4777-84de-1b196d42b52e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:40.107831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76df46-f684-4777-84de-1b196d42b52e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:40.107955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76df46-f684-4777-84de-1b196d42b52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:40.130869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-4e76df46-f684-4777-84de-1b196d42b52e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:40.132006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4e76df46-f684-4777-84de-1b196d42b52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:40.138894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 651/1301] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:04:40.227235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c3bcd-6477-4327-bca5-1244334401e7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:40.240692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c3bcd-6477-4327-bca5-1244334401e7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:40.245477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12243-6919-4c6e-a288-e47e02b6f424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:40.246049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12243-6919-4c6e-a288-e47e02b6f424 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:40.246337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12243-6919-4c6e-a288-e47e02b6f424 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:40.246640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12243-6919-4c6e-a288-e47e02b6f424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:40.254882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c12243-6919-4c6e-a288-e47e02b6f424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:40.281351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c12243-6919-4c6e-a288-e47e02b6f424 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:40.290641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 651/1302] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:42.397799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44485-ab0c-42d7-bc2a-91e37c6df017 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:42.398341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44485-ab0c-42d7-bc2a-91e37c6df017 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:42.398461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44485-ab0c-42d7-bc2a-91e37c6df017 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:42.400128 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 652/1303] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:42.405312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8598fa-791d-481d-a814-2b202a46a2b0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:42.405749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8598fa-791d-481d-a814-2b202a46a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:42.405895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8598fa-791d-481d-a814-2b202a46a2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:42.429398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-ac8598fa-791d-481d-a814-2b202a46a2b0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:42.430557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ac8598fa-791d-481d-a814-2b202a46a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:42.438161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 652/1304] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:42.522287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44485-ab0c-42d7-bc2a-91e37c6df017 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:42.535811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44485-ab0c-42d7-bc2a-91e37c6df017 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:42.540863 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c2cc6-660b-41a2-a0b8-7c1650199066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:42.541437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c2cc6-660b-41a2-a0b8-7c1650199066 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:42.541731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c2cc6-660b-41a2-a0b8-7c1650199066 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:42.542018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c2cc6-660b-41a2-a0b8-7c1650199066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:42.550575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c2cc6-660b-41a2-a0b8-7c1650199066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:42.576106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c2cc6-660b-41a2-a0b8-7c1650199066 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:42.585211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 653/1305] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:44.550735 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389a2c8-9287-4389-8b3b-0f8a94021c62 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:44.551295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389a2c8-9287-4389-8b3b-0f8a94021c62 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:44.551295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389a2c8-9287-4389-8b3b-0f8a94021c62 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:44.552968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 653/1306] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:44.558169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db13f-69bc-48e8-867f-8eb4c65d1b27 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:44.558696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db13f-69bc-48e8-867f-8eb4c65d1b27 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:44.558797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db13f-69bc-48e8-867f-8eb4c65d1b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:44.581120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c68db13f-69bc-48e8-867f-8eb4c65d1b27 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:44.582265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c68db13f-69bc-48e8-867f-8eb4c65d1b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:44.589272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 654/1307] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:44.675838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389a2c8-9287-4389-8b3b-0f8a94021c62 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:44.689530 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389a2c8-9287-4389-8b3b-0f8a94021c62 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:44.694409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5060103-ab93-48c0-ae9b-4167b1841ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:44.695023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5060103-ab93-48c0-ae9b-4167b1841ac7 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:44.695319 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5060103-ab93-48c0-ae9b-4167b1841ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:44.695604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5060103-ab93-48c0-ae9b-4167b1841ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:44.704072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5060103-ab93-48c0-ae9b-4167b1841ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:44.729745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5060103-ab93-48c0-ae9b-4167b1841ac7 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:44.739564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 654/1308] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:46.830173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3a45f-72eb-467a-bd23-f92c216d0bf1 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:46.830847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3a45f-72eb-467a-bd23-f92c216d0bf1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:46.830847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3a45f-72eb-467a-bd23-f92c216d0bf1 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:46.832529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 655/1309] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:46.838005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599b584-620d-40bf-9fc7-84a23f479b9a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:46.838459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599b584-620d-40bf-9fc7-84a23f479b9a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:46.838570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599b584-620d-40bf-9fc7-84a23f479b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:46.863412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3599b584-620d-40bf-9fc7-84a23f479b9a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:46.864550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3599b584-620d-40bf-9fc7-84a23f479b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:46.871792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 655/1310] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:46.960391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3a45f-72eb-467a-bd23-f92c216d0bf1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:46.974176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3a45f-72eb-467a-bd23-f92c216d0bf1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:46.979030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7896f6-27ab-4ac5-a213-b604fed074ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:46.979599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7896f6-27ab-4ac5-a213-b604fed074ad service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:46.979888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7896f6-27ab-4ac5-a213-b604fed074ad service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:46.980171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7896f6-27ab-4ac5-a213-b604fed074ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:46.988759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7896f6-27ab-4ac5-a213-b604fed074ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:47.013757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7896f6-27ab-4ac5-a213-b604fed074ad service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:47.023949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 656/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:49.106228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152bb45-a4f1-4b05-832d-880d8cb643f3 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:49.106797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152bb45-a4f1-4b05-832d-880d8cb643f3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:49.106910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152bb45-a4f1-4b05-832d-880d8cb643f3 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:49.108533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 656/1312] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:49.114587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe075-d305-4f11-b759-15dc833a38ce None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:49.115050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe075-d305-4f11-b759-15dc833a38ce None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:49.115189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe075-d305-4f11-b759-15dc833a38ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:49.138133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-077fe075-d305-4f11-b759-15dc833a38ce None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:49.139291 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-077fe075-d305-4f11-b759-15dc833a38ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:49.146196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 657/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:49.241104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152bb45-a4f1-4b05-832d-880d8cb643f3 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:49.255544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152bb45-a4f1-4b05-832d-880d8cb643f3 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:49.260465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b3028-0f16-4e64-a8e9-c6439c114738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:49.261042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b3028-0f16-4e64-a8e9-c6439c114738 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:49.261362 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b3028-0f16-4e64-a8e9-c6439c114738 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:49.261649 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b3028-0f16-4e64-a8e9-c6439c114738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:49.270041 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b3028-0f16-4e64-a8e9-c6439c114738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:49.297253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b3028-0f16-4e64-a8e9-c6439c114738 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:49.306453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 657/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:51.390557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14b8db-6f8f-40d6-a3d0-78173d4e7f3e None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:51.391342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14b8db-6f8f-40d6-a3d0-78173d4e7f3e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:51.391342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14b8db-6f8f-40d6-a3d0-78173d4e7f3e None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:51.392920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 658/1315] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:51.398476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed38a-89d0-4511-8542-aae74447a466 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:51.398956 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed38a-89d0-4511-8542-aae74447a466 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:51.399072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed38a-89d0-4511-8542-aae74447a466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:51.422148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c96ed38a-89d0-4511-8542-aae74447a466 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:51.423460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c96ed38a-89d0-4511-8542-aae74447a466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:51.430396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 658/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:04:51.519456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14b8db-6f8f-40d6-a3d0-78173d4e7f3e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:51.533485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14b8db-6f8f-40d6-a3d0-78173d4e7f3e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:51.538759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8287e-1e70-486e-b364-b80fe27ddebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:51.539349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8287e-1e70-486e-b364-b80fe27ddebf service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:51.539648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8287e-1e70-486e-b364-b80fe27ddebf service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:51.539933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8287e-1e70-486e-b364-b80fe27ddebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:51.548731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8287e-1e70-486e-b364-b80fe27ddebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:51.574784 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8287e-1e70-486e-b364-b80fe27ddebf service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:51.585070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 659/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:04:53.715932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1acca-d292-4c19-a9e9-1478be6fa12f None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:53.716474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1acca-d292-4c19-a9e9-1478be6fa12f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:53.716474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1acca-d292-4c19-a9e9-1478be6fa12f None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:53.718597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 659/1318] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:04:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:04:53.724422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fbb2d-fa85-43f2-8043-689606c08a61 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:53.724872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fbb2d-fa85-43f2-8043-689606c08a61 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:53.725000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fbb2d-fa85-43f2-8043-689606c08a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:53.747405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a93fbb2d-fa85-43f2-8043-689606c08a61 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:04:53.748576 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a93fbb2d-fa85-43f2-8043-689606c08a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:04:53.755958 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 660/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:04:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:04:53.843154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1acca-d292-4c19-a9e9-1478be6fa12f None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:04:53.856526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1acca-d292-4c19-a9e9-1478be6fa12f None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:04:53.864480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b55999-49bb-4ac8-a9bb-2bcfbc35e3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:04:53.865988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55999-49bb-4ac8-a9bb-2bcfbc35e3e6 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:04:53.866292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55999-49bb-4ac8-a9bb-2bcfbc35e3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:04:53.866586 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55999-49bb-4ac8-a9bb-2bcfbc35e3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:04:53.875970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b55999-49bb-4ac8-a9bb-2bcfbc35e3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:04:53.901672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b55999-49bb-4ac8-a9bb-2bcfbc35e3e6 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:04:53.911036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 660/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:04:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:05:04.098860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ade7-c727-4cd1-a3b3-6009202169b5 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:04.099391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ade7-c727-4cd1-a3b3-6009202169b5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:04.099506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ade7-c727-4cd1-a3b3-6009202169b5 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:04.101097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 661/1321] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:04.106337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1d17a-1c3e-4f1c-af8b-c27af6992953 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:04.106819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1d17a-1c3e-4f1c-af8b-c27af6992953 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:04.106928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1d17a-1c3e-4f1c-af8b-c27af6992953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:04.129363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-18f1d17a-1c3e-4f1c-af8b-c27af6992953 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:04.130504 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-18f1d17a-1c3e-4f1c-af8b-c27af6992953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:04.137411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 661/1322] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:04.200838 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e77e8-00d5-45fe-bf58-2137270f331a None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:04.201234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e77e8-00d5-45fe-bf58-2137270f331a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:04.201533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e77e8-00d5-45fe-bf58-2137270f331a None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:04.203985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 662/1323] 10.222.0.36 () {54 vars in 961 bytes} [Wed Oct 27 14:05:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:04.209014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da349d-0e15-46a8-a587-451a1a7c769e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:04.209310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da349d-0e15-46a8-a587-451a1a7c769e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:04.209629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da349d-0e15-46a8-a587-451a1a7c769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:04.284711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c9da349d-0e15-46a8-a587-451a1a7c769e None None] MFA Rules not processed for user `3c014f6c51ed4c99a1a4450dde18cbef`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:04.285752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c9da349d-0e15-46a8-a587-451a1a7c769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:04.352422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 662/1324] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Oct 27 14:05:04 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:04.360270 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e77e8-00d5-45fe-bf58-2137270f331a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:04.370872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e77e8-00d5-45fe-bf58-2137270f331a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:04.374099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ac77-c328-4688-a81c-2b5d90106388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:04.375547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ac77-c328-4688-a81c-2b5d90106388 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:04.375910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ac77-c328-4688-a81c-2b5d90106388 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:04.376267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ac77-c328-4688-a81c-2b5d90106388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:04.385283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8ac77-c328-4688-a81c-2b5d90106388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:04.411752 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8ac77-c328-4688-a81c-2b5d90106388 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:04.421617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 663/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:05:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:05:18.174638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd686f1e-4b5a-4136-8a64-1255862faa07 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:18.175242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd686f1e-4b5a-4136-8a64-1255862faa07 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:18.175344 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd686f1e-4b5a-4136-8a64-1255862faa07 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:18.177027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 663/1326] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:18.182229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d606d-0cfc-4d66-ac38-f75844f02fa2 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:18.182705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d606d-0cfc-4d66-ac38-f75844f02fa2 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:18.182832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d606d-0cfc-4d66-ac38-f75844f02fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:18.206377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a29d606d-0cfc-4d66-ac38-f75844f02fa2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:18.207476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a29d606d-0cfc-4d66-ac38-f75844f02fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:18.214459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 664/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:05:18.276911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c1e26-b325-4a30-b631-5217cf489d80 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:18.277234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c1e26-b325-4a30-b631-5217cf489d80 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:18.277531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c1e26-b325-4a30-b631-5217cf489d80 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:18.279252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 664/1328] 10.222.0.36 () {54 vars in 956 bytes} [Wed Oct 27 14:05:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:18.285521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438815cf-d66b-4307-b28a-b10861118898 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:18.285820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438815cf-d66b-4307-b28a-b10861118898 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:18.286112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438815cf-d66b-4307-b28a-b10861118898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:18.353496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-438815cf-d66b-4307-b28a-b10861118898 None None] MFA Rules not processed for user `88ddc229d1a0446c83956f9f0c1ddbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:18.354676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-438815cf-d66b-4307-b28a-b10861118898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:18.423711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 665/1329] 10.222.0.36 () {58 vars in 1053 bytes} [Wed Oct 27 14:05:18 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:05:18.433761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c1e26-b325-4a30-b631-5217cf489d80 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:18.444877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c1e26-b325-4a30-b631-5217cf489d80 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:18.448261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b0c26-4944-438f-86e0-a77176159c8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ddc229d1a0446c83956f9f0c1ddbfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:18.448837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0c26-4944-438f-86e0-a77176159c8a service glance] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:18.449132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0c26-4944-438f-86e0-a77176159c8a service glance] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:18.449472 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0c26-4944-438f-86e0-a77176159c8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:18.458696 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0c26-4944-438f-86e0-a77176159c8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:18.483653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0c26-4944-438f-86e0-a77176159c8a service glance] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:18.493859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 665/1330] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:05:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:05:18.883895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c62264-8db1-4d80-ae95-e385380fe35e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:18.884204 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c62264-8db1-4d80-ae95-e385380fe35e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:18.884519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c62264-8db1-4d80-ae95-e385380fe35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:18.952603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-d4c62264-8db1-4d80-ae95-e385380fe35e None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:18.953759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d4c62264-8db1-4d80-ae95-e385380fe35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:19.031193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 666/1331] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:05:18 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:19.072074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bdf50-772d-40a0-a0ed-e2306cc9fed5 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:19.072395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bdf50-772d-40a0-a0ed-e2306cc9fed5 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:19.072711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bdf50-772d-40a0-a0ed-e2306cc9fed5 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:19.074411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 666/1332] 10.222.0.36 () {54 vars in 942 bytes} [Wed Oct 27 14:05:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:19.080922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785907d-64a5-416a-b24d-f6470726375b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:19.081286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785907d-64a5-416a-b24d-f6470726375b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:19.081575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785907d-64a5-416a-b24d-f6470726375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:19.150256 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5785907d-64a5-416a-b24d-f6470726375b None None] MFA Rules not processed for user `e56f87a3cc4c4503a156700b66525530`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:19.151427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5785907d-64a5-416a-b24d-f6470726375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:19.235068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 667/1333] 10.222.0.36 () {58 vars in 1039 bytes} [Wed Oct 27 14:05:19 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:19.244017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bdf50-772d-40a0-a0ed-e2306cc9fed5 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:19.256517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bdf50-772d-40a0-a0ed-e2306cc9fed5 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:19.261132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86efa10-9de3-4572-9292-38b84121dcf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:19.261720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efa10-9de3-4572-9292-38b84121dcf4 service swift] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:19.262013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efa10-9de3-4572-9292-38b84121dcf4 service swift] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:19.262297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efa10-9de3-4572-9292-38b84121dcf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:19.271233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86efa10-9de3-4572-9292-38b84121dcf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:19.296908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86efa10-9de3-4572-9292-38b84121dcf4 service swift] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:19.304896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 667/1334] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:05:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:05:38.608389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6f21-c909-4696-8984-a303a6e830e9 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:38.609000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6f21-c909-4696-8984-a303a6e830e9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:38.609000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef6f21-c909-4696-8984-a303a6e830e9 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:38.610763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 668/1335] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:38.617124 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693aedb-1865-4303-87f6-85c6a7936b84 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:38.617575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693aedb-1865-4303-87f6-85c6a7936b84 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:38.617711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693aedb-1865-4303-87f6-85c6a7936b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:38.640567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-f693aedb-1865-4303-87f6-85c6a7936b84 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:38.641705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f693aedb-1865-4303-87f6-85c6a7936b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:38.649219 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 668/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:38.672285 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef6f21-c909-4696-8984-a303a6e830e9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:38.685022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef6f21-c909-4696-8984-a303a6e830e9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:38.689856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36b3ca-276b-4ce9-8464-14e2fccdcd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:38.690448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36b3ca-276b-4ce9-8464-14e2fccdcd2a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:38.690779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36b3ca-276b-4ce9-8464-14e2fccdcd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:38.691069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36b3ca-276b-4ce9-8464-14e2fccdcd2a admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:38.691767 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36b3ca-276b-4ce9-8464-14e2fccdcd2a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:38.718337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36b3ca-276b-4ce9-8464-14e2fccdcd2a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:38.734361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 669/1337] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 14:05:38 2021] GET /identity/v3/projects => generated 2553 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:05:40.680386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6cb21-cf2c-44a2-8c44-505f006da18e None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:40.680946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6cb21-cf2c-44a2-8c44-505f006da18e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:40.680946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6cb21-cf2c-44a2-8c44-505f006da18e None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:40.682667 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 669/1338] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:40.688088 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699474-28cb-4250-843e-2346668a1a05 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:40.688583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699474-28cb-4250-843e-2346668a1a05 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:40.688687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699474-28cb-4250-843e-2346668a1a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:40.711569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-42699474-28cb-4250-843e-2346668a1a05 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:40.712866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-42699474-28cb-4250-843e-2346668a1a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:40.720081 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 670/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:40.743084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6cb21-cf2c-44a2-8c44-505f006da18e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:40.755469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6cb21-cf2c-44a2-8c44-505f006da18e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:40.759518 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e79b-c606-4896-832b-760afcc34a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:40.760295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e79b-c606-4896-832b-760afcc34a50 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:40.760585 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e79b-c606-4896-832b-760afcc34a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:40.760864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e79b-c606-4896-832b-760afcc34a50 admin admin] PATH_INFO: `/v3/projects/1e80d98f09924acdb64835c3e7c3f14a` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:40.773437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6e79b-c606-4896-832b-760afcc34a50 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e80d98f09924acdb64835c3e7c3f14a)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:40.799733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6e79b-c606-4896-832b-760afcc34a50 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:40.801414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 670/1340] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:05:40 2021] GET /identity/v3/projects/1e80d98f09924acdb64835c3e7c3f14a => generated 311 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:40.808229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699474-28cb-4250-843e-2346668a1a05 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:40.818092 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699474-28cb-4250-843e-2346668a1a05 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:40.822905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01006919-6653-4f6d-834c-0eadd60071dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:40.823608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01006919-6653-4f6d-834c-0eadd60071dc admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:40.823905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01006919-6653-4f6d-834c-0eadd60071dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:40.824232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01006919-6653-4f6d-834c-0eadd60071dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:40.824980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01006919-6653-4f6d-834c-0eadd60071dc admin admin] RBAC: Adding query filter params (scope.project.id=1e80d98f09924acdb64835c3e7c3f14a) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:05:40.825287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01006919-6653-4f6d-834c-0eadd60071dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:40.852107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01006919-6653-4f6d-834c-0eadd60071dc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:40.858857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 671/1341] 10.222.0.36 () {56 vars in 1231 bytes} [Wed Oct 27 14:05:40 2021] GET /identity/v3/role_assignments?scope.project.id=1e80d98f09924acdb64835c3e7c3f14a => generated 526 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:40.865908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e79b-c606-4896-832b-760afcc34a50 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:40.876079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e79b-c606-4896-832b-760afcc34a50 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:40.880997 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72fc53-abda-4a41-8a11-9cfaa6e23ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:40.881791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fc53-abda-4a41-8a11-9cfaa6e23ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:40.882083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fc53-abda-4a41-8a11-9cfaa6e23ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:40.882380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72fc53-abda-4a41-8a11-9cfaa6e23ae6 admin admin] PATH_INFO: `/v3/users/56ed375dbd0f4d2493faa9d3c5695dab` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:40.902113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72fc53-abda-4a41-8a11-9cfaa6e23ae6 admin admin] RBAC: Authorizing `identity:get_user(user_id=56ed375dbd0f4d2493faa9d3c5695dab)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:40.930374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72fc53-abda-4a41-8a11-9cfaa6e23ae6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:40.932060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 671/1342] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:40 2021] GET /identity/v3/users/56ed375dbd0f4d2493faa9d3c5695dab => generated 286 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:42.932693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b2002-0c5d-43fd-bd4a-48c80b3af3a3 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:42.933259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b2002-0c5d-43fd-bd4a-48c80b3af3a3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:42.933259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b2002-0c5d-43fd-bd4a-48c80b3af3a3 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:42.935015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 672/1343] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:42.940634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ac541-619f-4640-95fb-e3a3c1a8c33a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:42.941059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ac541-619f-4640-95fb-e3a3c1a8c33a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:42.941200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ac541-619f-4640-95fb-e3a3c1a8c33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:42.966067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-340ac541-619f-4640-95fb-e3a3c1a8c33a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:42.968095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-340ac541-619f-4640-95fb-e3a3c1a8c33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:42.974924 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 672/1344] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:42.998294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b2002-0c5d-43fd-bd4a-48c80b3af3a3 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:43.010566 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b2002-0c5d-43fd-bd4a-48c80b3af3a3 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:43.014807 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc32d1-1ac2-4290-a81b-22813bdbca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:43.015593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc32d1-1ac2-4290-a81b-22813bdbca5c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:43.015885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc32d1-1ac2-4290-a81b-22813bdbca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:43.016170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc32d1-1ac2-4290-a81b-22813bdbca5c admin admin] PATH_INFO: `/v3/projects/833020c6e97d4c80bbe449fc92e597a4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:43.028718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc32d1-1ac2-4290-a81b-22813bdbca5c admin admin] RBAC: Authorizing `identity:get_project(project_id=833020c6e97d4c80bbe449fc92e597a4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:43.055302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc32d1-1ac2-4290-a81b-22813bdbca5c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:43.056951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 673/1345] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:05:42 2021] GET /identity/v3/projects/833020c6e97d4c80bbe449fc92e597a4 => generated 302 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:43.063261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ac541-619f-4640-95fb-e3a3c1a8c33a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:43.072332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ac541-619f-4640-95fb-e3a3c1a8c33a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:43.076519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22b284-49c9-46b6-a5d2-2bab23d19a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:43.077104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22b284-49c9-46b6-a5d2-2bab23d19a37 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:43.077399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22b284-49c9-46b6-a5d2-2bab23d19a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:43.077689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22b284-49c9-46b6-a5d2-2bab23d19a37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:43.078409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22b284-49c9-46b6-a5d2-2bab23d19a37 admin admin] RBAC: Adding query filter params (scope.project.id=833020c6e97d4c80bbe449fc92e597a4) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:05:43.078750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22b284-49c9-46b6-a5d2-2bab23d19a37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:43.104704 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22b284-49c9-46b6-a5d2-2bab23d19a37 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:43.112313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 673/1346] 10.222.0.36 () {56 vars in 1231 bytes} [Wed Oct 27 14:05:43 2021] GET /identity/v3/role_assignments?scope.project.id=833020c6e97d4c80bbe449fc92e597a4 => generated 1934 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:05:43.119245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc32d1-1ac2-4290-a81b-22813bdbca5c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:43.128859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc32d1-1ac2-4290-a81b-22813bdbca5c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:43.133002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33c174-9789-49c4-9278-94246853625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:43.133794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c174-9789-49c4-9278-94246853625c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:43.134080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c174-9789-49c4-9278-94246853625c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:43.134363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c174-9789-49c4-9278-94246853625c admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:43.135474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33c174-9789-49c4-9278-94246853625c admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:43.163761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33c174-9789-49c4-9278-94246853625c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:43.165239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 674/1347] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:43 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:43.170911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22b284-49c9-46b6-a5d2-2bab23d19a37 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:43.180676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22b284-49c9-46b6-a5d2-2bab23d19a37 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:43.184999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104be70-0632-4152-a5af-728487f74237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:43.185734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104be70-0632-4152-a5af-728487f74237 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:43.186024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104be70-0632-4152-a5af-728487f74237 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:43.186307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104be70-0632-4152-a5af-728487f74237 admin admin] PATH_INFO: `/v3/users/ad23da8435de4197b014b33efda92485` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:43.205977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104be70-0632-4152-a5af-728487f74237 admin admin] RBAC: Authorizing `identity:get_user(user_id=ad23da8435de4197b014b33efda92485)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:43.232266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104be70-0632-4152-a5af-728487f74237 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:43.233833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 674/1348] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:43 2021] GET /identity/v3/users/ad23da8435de4197b014b33efda92485 => generated 283 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:45.289266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446b6f5-09bc-4f88-b92a-3dc9342101bd None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:45.289786 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446b6f5-09bc-4f88-b92a-3dc9342101bd None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:45.289786 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446b6f5-09bc-4f88-b92a-3dc9342101bd None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:45.291456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 675/1349] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:45.296781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c993c2-2212-40bf-bccc-768f5dcc81c5 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:45.297186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c993c2-2212-40bf-bccc-768f5dcc81c5 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:45.297357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c993c2-2212-40bf-bccc-768f5dcc81c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:45.320645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-23c993c2-2212-40bf-bccc-768f5dcc81c5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:45.321779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-23c993c2-2212-40bf-bccc-768f5dcc81c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:45.328619 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 675/1350] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:05:45.351176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446b6f5-09bc-4f88-b92a-3dc9342101bd None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:45.363780 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446b6f5-09bc-4f88-b92a-3dc9342101bd None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:45.368145 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b19f58-0298-4e23-98b1-ad97aae72d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:45.368918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19f58-0298-4e23-98b1-ad97aae72d80 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:45.369208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19f58-0298-4e23-98b1-ad97aae72d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:45.369488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19f58-0298-4e23-98b1-ad97aae72d80 admin admin] PATH_INFO: `/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:45.382654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b19f58-0298-4e23-98b1-ad97aae72d80 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7a7d1331b8144a19205ad2b0f3ce026)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:45.408140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b19f58-0298-4e23-98b1-ad97aae72d80 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:45.409744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 676/1351] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:05:45 2021] GET /identity/v3/projects/a7a7d1331b8144a19205ad2b0f3ce026 => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:45.415843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c993c2-2212-40bf-bccc-768f5dcc81c5 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:45.425140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c993c2-2212-40bf-bccc-768f5dcc81c5 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:45.429358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa2391-78a3-4893-b754-154ab8d47dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:45.429936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa2391-78a3-4893-b754-154ab8d47dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:45.430229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa2391-78a3-4893-b754-154ab8d47dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:45.430515 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa2391-78a3-4893-b754-154ab8d47dd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:45.431263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa2391-78a3-4893-b754-154ab8d47dd4 admin admin] RBAC: Adding query filter params (scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:05:45.431566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa2391-78a3-4893-b754-154ab8d47dd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:45.457609 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa2391-78a3-4893-b754-154ab8d47dd4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:45.464475 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 676/1352] 10.222.0.36 () {56 vars in 1231 bytes} [Wed Oct 27 14:05:45 2021] GET /identity/v3/role_assignments?scope.project.id=a7a7d1331b8144a19205ad2b0f3ce026 => generated 1934 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:05:45.470463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b19f58-0298-4e23-98b1-ad97aae72d80 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:45.480199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b19f58-0298-4e23-98b1-ad97aae72d80 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:45.484356 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99cc48-5cef-4fa1-bcfd-40dcedc4c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:45.485148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99cc48-5cef-4fa1-bcfd-40dcedc4c8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:45.485437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99cc48-5cef-4fa1-bcfd-40dcedc4c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:45.485722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99cc48-5cef-4fa1-bcfd-40dcedc4c8c5 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:45.506349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99cc48-5cef-4fa1-bcfd-40dcedc4c8c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:45.532119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99cc48-5cef-4fa1-bcfd-40dcedc4c8c5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:45.533964 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 677/1353] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:45 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:45.539814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa2391-78a3-4893-b754-154ab8d47dd4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:45.549759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa2391-78a3-4893-b754-154ab8d47dd4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:45.553898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24618c96-a1a8-44cf-b4e4-4f580f827051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:45.554742 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24618c96-a1a8-44cf-b4e4-4f580f827051 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:45.555039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24618c96-a1a8-44cf-b4e4-4f580f827051 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:45.555334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24618c96-a1a8-44cf-b4e4-4f580f827051 admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:45.556437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24618c96-a1a8-44cf-b4e4-4f580f827051 admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:45.582523 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24618c96-a1a8-44cf-b4e4-4f580f827051 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:45.584066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 677/1354] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:45 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:47.646519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c2ed-a3a4-4cc1-ad24-9085dd933a1d None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:47.647069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c2ed-a3a4-4cc1-ad24-9085dd933a1d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:47.647069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c2ed-a3a4-4cc1-ad24-9085dd933a1d None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:47.648701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 678/1355] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:47.653954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e559d-a567-4b15-a8d1-9b347083bc72 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:47.654396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e559d-a567-4b15-a8d1-9b347083bc72 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:47.654691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e559d-a567-4b15-a8d1-9b347083bc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:47.678436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-fc0e559d-a567-4b15-a8d1-9b347083bc72 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:47.679601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fc0e559d-a567-4b15-a8d1-9b347083bc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:47.686480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 678/1356] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:47.709422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c2ed-a3a4-4cc1-ad24-9085dd933a1d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:47.721225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c2ed-a3a4-4cc1-ad24-9085dd933a1d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:47.725288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6107a-3e9a-4922-881a-b1794c8df9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:47.726062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6107a-3e9a-4922-881a-b1794c8df9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:47.726349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6107a-3e9a-4922-881a-b1794c8df9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:47.726661 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6107a-3e9a-4922-881a-b1794c8df9b7 admin admin] PATH_INFO: `/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:47.727730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6107a-3e9a-4922-881a-b1794c8df9b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdb79eb1d18d4b408274e7d70cc19ee8)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:47.754304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6107a-3e9a-4922-881a-b1794c8df9b7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:47.755917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 679/1357] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:05:47 2021] GET /identity/v3/projects/cdb79eb1d18d4b408274e7d70cc19ee8 => generated 344 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:47.761832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e559d-a567-4b15-a8d1-9b347083bc72 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:47.770671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e559d-a567-4b15-a8d1-9b347083bc72 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:47.774768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91275ed9-6b86-44e2-bbfa-2242939dacf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:47.775347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275ed9-6b86-44e2-bbfa-2242939dacf1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:47.775637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275ed9-6b86-44e2-bbfa-2242939dacf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:47.775921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275ed9-6b86-44e2-bbfa-2242939dacf1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:47.776719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91275ed9-6b86-44e2-bbfa-2242939dacf1 admin admin] RBAC: Adding query filter params (scope.project.id=cdb79eb1d18d4b408274e7d70cc19ee8) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:05:47.777016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91275ed9-6b86-44e2-bbfa-2242939dacf1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:47.802893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91275ed9-6b86-44e2-bbfa-2242939dacf1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:47.809019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 679/1358] 10.222.0.36 () {56 vars in 1231 bytes} [Wed Oct 27 14:05:47 2021] GET /identity/v3/role_assignments?scope.project.id=cdb79eb1d18d4b408274e7d70cc19ee8 => generated 879 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:47.815787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6107a-3e9a-4922-881a-b1794c8df9b7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:47.825620 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6107a-3e9a-4922-881a-b1794c8df9b7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:47.829944 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20200-813e-4f65-a0d0-5c2fd0313e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:47.830768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20200-813e-4f65-a0d0-5c2fd0313e25 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:47.831064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20200-813e-4f65-a0d0-5c2fd0313e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:47.831352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20200-813e-4f65-a0d0-5c2fd0313e25 admin admin] PATH_INFO: `/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:47.832468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20200-813e-4f65-a0d0-5c2fd0313e25 admin admin] RBAC: Authorizing `identity:get_user(user_id=35ed18ce25b9435aaf42d0a0ed7b1a41)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:47.857625 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20200-813e-4f65-a0d0-5c2fd0313e25 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:47.859193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 680/1359] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:47 2021] GET /identity/v3/users/35ed18ce25b9435aaf42d0a0ed7b1a41 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:49.873943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788803-1e46-481d-956d-c2eba56a5587 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:49.874498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788803-1e46-481d-956d-c2eba56a5587 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:49.874498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788803-1e46-481d-956d-c2eba56a5587 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:49.876215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 680/1360] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:49.881527 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d6532-d0dd-4ccc-ae7e-adfc18adf27e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:49.881966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d6532-d0dd-4ccc-ae7e-adfc18adf27e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:49.882092 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d6532-d0dd-4ccc-ae7e-adfc18adf27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:49.905117 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-f89d6532-d0dd-4ccc-ae7e-adfc18adf27e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:49.906255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-f89d6532-d0dd-4ccc-ae7e-adfc18adf27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:49.913908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 681/1361] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:49.936196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788803-1e46-481d-956d-c2eba56a5587 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:49.948205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788803-1e46-481d-956d-c2eba56a5587 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:49.952294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec0f8-4f96-4ca1-a217-beabf1925310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:49.953081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec0f8-4f96-4ca1-a217-beabf1925310 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:49.953376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec0f8-4f96-4ca1-a217-beabf1925310 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:49.953662 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec0f8-4f96-4ca1-a217-beabf1925310 admin admin] PATH_INFO: `/v3/projects/cea479439d4b4c65b87afc7a2faa05e7` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:49.966514 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ec0f8-4f96-4ca1-a217-beabf1925310 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea479439d4b4c65b87afc7a2faa05e7)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:49.992925 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ec0f8-4f96-4ca1-a217-beabf1925310 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:49.994582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 681/1362] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:05:49 2021] GET /identity/v3/projects/cea479439d4b4c65b87afc7a2faa05e7 => generated 361 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:50.000598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d6532-d0dd-4ccc-ae7e-adfc18adf27e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:50.009605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d6532-d0dd-4ccc-ae7e-adfc18adf27e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:50.013920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6d0eb-73c9-4248-bb5d-27470bdce0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:50.014506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6d0eb-73c9-4248-bb5d-27470bdce0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:50.014843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6d0eb-73c9-4248-bb5d-27470bdce0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:50.015126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6d0eb-73c9-4248-bb5d-27470bdce0e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:50.015848 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6d0eb-73c9-4248-bb5d-27470bdce0e5 admin admin] RBAC: Adding query filter params (scope.project.id=cea479439d4b4c65b87afc7a2faa05e7) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:05:50.016146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6d0eb-73c9-4248-bb5d-27470bdce0e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:50.044427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6d0eb-73c9-4248-bb5d-27470bdce0e5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:50.050504 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 682/1363] 10.222.0.36 () {56 vars in 1231 bytes} [Wed Oct 27 14:05:49 2021] GET /identity/v3/role_assignments?scope.project.id=cea479439d4b4c65b87afc7a2faa05e7 => generated 526 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:50.056412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec0f8-4f96-4ca1-a217-beabf1925310 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:50.065805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec0f8-4f96-4ca1-a217-beabf1925310 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:50.069919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ec50c-1e92-4eb9-b87c-b096f1e8cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:50.070751 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ec50c-1e92-4eb9-b87c-b096f1e8cb5c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:50.071044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ec50c-1e92-4eb9-b87c-b096f1e8cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:50.071333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ec50c-1e92-4eb9-b87c-b096f1e8cb5c admin admin] PATH_INFO: `/v3/users/00974628e5654246861d9fdb13c87ac9` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:50.091870 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ec50c-1e92-4eb9-b87c-b096f1e8cb5c admin admin] RBAC: Authorizing `identity:get_user(user_id=00974628e5654246861d9fdb13c87ac9)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:50.118352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ec50c-1e92-4eb9-b87c-b096f1e8cb5c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:50.119983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 682/1364] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:50 2021] GET /identity/v3/users/00974628e5654246861d9fdb13c87ac9 => generated 311 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:52.164306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5d074-a2c0-45f7-a470-a54fc63974d7 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:52.164858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5d074-a2c0-45f7-a470-a54fc63974d7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:52.164858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5d074-a2c0-45f7-a470-a54fc63974d7 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:52.166542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 683/1365] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:52.171816 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d605-89a0-465c-883b-f6229522396b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:52.172226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d605-89a0-465c-883b-f6229522396b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:52.172392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d605-89a0-465c-883b-f6229522396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:52.195003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3a31d605-89a0-465c-883b-f6229522396b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:52.196142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3a31d605-89a0-465c-883b-f6229522396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:52.203022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 683/1366] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:52.226041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5d074-a2c0-45f7-a470-a54fc63974d7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:52.238033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5d074-a2c0-45f7-a470-a54fc63974d7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:52.242034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdc722-7ce7-40dc-8366-5155d0adc68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:52.242874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdc722-7ce7-40dc-8366-5155d0adc68c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:52.243132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdc722-7ce7-40dc-8366-5155d0adc68c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:52.243416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdc722-7ce7-40dc-8366-5155d0adc68c admin admin] PATH_INFO: `/v3/projects/e0184ddc4498473b9b484da1927efabb` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:52.255954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdc722-7ce7-40dc-8366-5155d0adc68c admin admin] RBAC: Authorizing `identity:get_project(project_id=e0184ddc4498473b9b484da1927efabb)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:52.282584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdc722-7ce7-40dc-8366-5155d0adc68c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:52.284909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 684/1367] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:05:52 2021] GET /identity/v3/projects/e0184ddc4498473b9b484da1927efabb => generated 311 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:52.291214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d605-89a0-465c-883b-f6229522396b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:52.299922 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d605-89a0-465c-883b-f6229522396b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:52.304225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83e6a-1588-41ca-ae44-933ee051b68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:52.304816 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83e6a-1588-41ca-ae44-933ee051b68f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:52.305102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83e6a-1588-41ca-ae44-933ee051b68f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:52.305378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b83e6a-1588-41ca-ae44-933ee051b68f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:52.306109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83e6a-1588-41ca-ae44-933ee051b68f admin admin] RBAC: Adding query filter params (scope.project.id=e0184ddc4498473b9b484da1927efabb) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:05:52.306386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83e6a-1588-41ca-ae44-933ee051b68f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:52.332154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b83e6a-1588-41ca-ae44-933ee051b68f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:52.337987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 684/1368] 10.222.0.36 () {56 vars in 1231 bytes} [Wed Oct 27 14:05:52 2021] GET /identity/v3/role_assignments?scope.project.id=e0184ddc4498473b9b484da1927efabb => generated 877 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:52.343752 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdc722-7ce7-40dc-8366-5155d0adc68c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:52.353778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdc722-7ce7-40dc-8366-5155d0adc68c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:52.357875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f44310-5211-4a0d-abf6-4f1bf0a682e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:52.358691 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f44310-5211-4a0d-abf6-4f1bf0a682e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:52.358986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f44310-5211-4a0d-abf6-4f1bf0a682e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:52.359268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f44310-5211-4a0d-abf6-4f1bf0a682e9 admin admin] PATH_INFO: `/v3/users/34e41630a13f42439de215f48822d252` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:52.378473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f44310-5211-4a0d-abf6-4f1bf0a682e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=34e41630a13f42439de215f48822d252)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:52.404836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f44310-5211-4a0d-abf6-4f1bf0a682e9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:52.406389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 685/1369] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:52 2021] GET /identity/v3/users/34e41630a13f42439de215f48822d252 => generated 285 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:52.412946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83e6a-1588-41ca-ae44-933ee051b68f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:52.422651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b83e6a-1588-41ca-ae44-933ee051b68f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:52.427315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad46dd3-0a73-4db5-bafd-a0b2e9da15fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:52.428113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46dd3-0a73-4db5-bafd-a0b2e9da15fc admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:52.428404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46dd3-0a73-4db5-bafd-a0b2e9da15fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:52.428697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad46dd3-0a73-4db5-bafd-a0b2e9da15fc admin admin] PATH_INFO: `/v3/users/1412d29489344a34868d7b99c0f27ad3` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:52.447276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad46dd3-0a73-4db5-bafd-a0b2e9da15fc admin admin] RBAC: Authorizing `identity:get_user(user_id=1412d29489344a34868d7b99c0f27ad3)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:52.473856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad46dd3-0a73-4db5-bafd-a0b2e9da15fc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:52.475401 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 685/1370] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:52 2021] GET /identity/v3/users/1412d29489344a34868d7b99c0f27ad3 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:54.532066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188c673-a5bc-4e30-840d-e27867542a06 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:54.532750 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188c673-a5bc-4e30-840d-e27867542a06 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:54.532750 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188c673-a5bc-4e30-840d-e27867542a06 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:54.534948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 686/1371] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:05:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:54.540277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601166ee-435d-4bcb-a3e1-63340099b788 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:54.540697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601166ee-435d-4bcb-a3e1-63340099b788 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:54.540916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601166ee-435d-4bcb-a3e1-63340099b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:54.563102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-601166ee-435d-4bcb-a3e1-63340099b788 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:54.564400 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-601166ee-435d-4bcb-a3e1-63340099b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:54.571536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 686/1372] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:05:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:54.593968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188c673-a5bc-4e30-840d-e27867542a06 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:54.610869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188c673-a5bc-4e30-840d-e27867542a06 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:54.615255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da062aec-dcb6-4c4b-8483-b27a2eeadfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:54.616040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da062aec-dcb6-4c4b-8483-b27a2eeadfbb admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:54.616354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da062aec-dcb6-4c4b-8483-b27a2eeadfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:54.616650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da062aec-dcb6-4c4b-8483-b27a2eeadfbb admin admin] PATH_INFO: `/v3/projects/e11bda8910464a189779d5093f615c5c` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:54.629442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da062aec-dcb6-4c4b-8483-b27a2eeadfbb admin admin] RBAC: Authorizing `identity:get_project(project_id=e11bda8910464a189779d5093f615c5c)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:54.655521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da062aec-dcb6-4c4b-8483-b27a2eeadfbb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:54.657106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 687/1373] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Oct 27 14:05:54 2021] GET /identity/v3/projects/e11bda8910464a189779d5093f615c5c => generated 312 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:54.663902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601166ee-435d-4bcb-a3e1-63340099b788 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:54.672961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601166ee-435d-4bcb-a3e1-63340099b788 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:54.677191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d995c-8ad5-485d-809d-644364ee5f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:54.677767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d995c-8ad5-485d-809d-644364ee5f96 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:54.678060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d995c-8ad5-485d-809d-644364ee5f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:54.678347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d995c-8ad5-485d-809d-644364ee5f96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:54.679110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d995c-8ad5-485d-809d-644364ee5f96 admin admin] RBAC: Adding query filter params (scope.project.id=e11bda8910464a189779d5093f615c5c) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:05:54.679416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d995c-8ad5-485d-809d-644364ee5f96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:54.705466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d995c-8ad5-485d-809d-644364ee5f96 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:54.711204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 687/1374] 10.222.0.36 () {56 vars in 1231 bytes} [Wed Oct 27 14:05:54 2021] GET /identity/v3/role_assignments?scope.project.id=e11bda8910464a189779d5093f615c5c => generated 526 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:54.717037 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da062aec-dcb6-4c4b-8483-b27a2eeadfbb admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:05:54.727193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da062aec-dcb6-4c4b-8483-b27a2eeadfbb admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:05:54.731215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541750a5-da83-4d13-a46e-a49e3d2707b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:05:54.732002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541750a5-da83-4d13-a46e-a49e3d2707b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:54.732290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541750a5-da83-4d13-a46e-a49e3d2707b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:54.732571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541750a5-da83-4d13-a46e-a49e3d2707b5 admin admin] PATH_INFO: `/v3/users/fbd81aca114b4057bcc77965ea8c47ba` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:54.733655 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541750a5-da83-4d13-a46e-a49e3d2707b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=fbd81aca114b4057bcc77965ea8c47ba)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:05:54.760001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541750a5-da83-4d13-a46e-a49e3d2707b5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:05:54.761512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 688/1375] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Oct 27 14:05:54 2021] GET /identity/v3/users/fbd81aca114b4057bcc77965ea8c47ba => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:05:59.471499 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8351f-1c34-4e68-baa6-518a5033848a None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:59.472408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8351f-1c34-4e68-baa6-518a5033848a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:59.472583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8351f-1c34-4e68-baa6-518a5033848a None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:59.474349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 688/1376] 10.222.0.36 () {54 vars in 918 bytes} [Wed Oct 27 14:05:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:59.479476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e7b59-571b-4d09-a143-309c8c065e72 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:59.479934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e7b59-571b-4d09-a143-309c8c065e72 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:59.480097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e7b59-571b-4d09-a143-309c8c065e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:59.503782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-aa5e7b59-571b-4d09-a143-309c8c065e72 None None] MFA Rules not processed for user `78404f52618b4d86a2a478f18b136773`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:59.504918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-aa5e7b59-571b-4d09-a143-309c8c065e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:59.512346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 689/1377] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Oct 27 14:05:59 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:05:59.571312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441982a-d20e-42bc-976c-ca2b15e68b08 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:59.571585 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441982a-d20e-42bc-976c-ca2b15e68b08 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:59.571869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441982a-d20e-42bc-976c-ca2b15e68b08 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:59.573543 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 689/1378] 10.222.0.36 () {54 vars in 918 bytes} [Wed Oct 27 14:05:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:05:59.578360 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ae982-68fd-4dab-9229-0c15dc3d0e51 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:05:59.578692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ae982-68fd-4dab-9229-0c15dc3d0e51 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:05:59.578985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ae982-68fd-4dab-9229-0c15dc3d0e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:05:59.603931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-613ae982-68fd-4dab-9229-0c15dc3d0e51 None None] MFA Rules not processed for user `a523c35d222f464e9d4f78ae990e3a17`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:05:59.605086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-613ae982-68fd-4dab-9229-0c15dc3d0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:05:59.614337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 690/1379] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Oct 27 14:05:59 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:02.001359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8560f5f-b3b4-4138-b113-99b4cfde5b81 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:02.001919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8560f5f-b3b4-4138-b113-99b4cfde5b81 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:02.001919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8560f5f-b3b4-4138-b113-99b4cfde5b81 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:02.004914 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 690/1380] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:02.010226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8538-0164-436c-a20e-f7c2b6cd8dee None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:02.010790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8538-0164-436c-a20e-f7c2b6cd8dee None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:02.010904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8538-0164-436c-a20e-f7c2b6cd8dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:02.032972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-999a8538-0164-436c-a20e-f7c2b6cd8dee None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:02.034155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-999a8538-0164-436c-a20e-f7c2b6cd8dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:02.041123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 691/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:02.130155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8560f5f-b3b4-4138-b113-99b4cfde5b81 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:02.143690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8560f5f-b3b4-4138-b113-99b4cfde5b81 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:02.148584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36031d82-050a-405f-b72c-3d57b2944ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:02.149161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031d82-050a-405f-b72c-3d57b2944ee1 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:02.149456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031d82-050a-405f-b72c-3d57b2944ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:02.149744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031d82-050a-405f-b72c-3d57b2944ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:02.157792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36031d82-050a-405f-b72c-3d57b2944ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:02.183437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36031d82-050a-405f-b72c-3d57b2944ee1 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:02.193282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 691/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:03.590987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9270c5-33e9-4999-b8ab-60e593a86e58 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:03.591542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9270c5-33e9-4999-b8ab-60e593a86e58 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:03.591542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9270c5-33e9-4999-b8ab-60e593a86e58 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:03.593347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 692/1383] 10.222.0.36 () {54 vars in 911 bytes} [Wed Oct 27 14:06:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:03.598303 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5efd-3254-49d9-9ce7-f1c4b813039e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:03.598701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5efd-3254-49d9-9ce7-f1c4b813039e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:03.598904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5efd-3254-49d9-9ce7-f1c4b813039e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:03.621607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1edf5efd-3254-49d9-9ce7-f1c4b813039e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:03.622556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1edf5efd-3254-49d9-9ce7-f1c4b813039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:03.629859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 692/1384] 10.222.0.36 () {58 vars in 1008 bytes} [Wed Oct 27 14:06:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:03.778091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9270c5-33e9-4999-b8ab-60e593a86e58 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:03.794032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9270c5-33e9-4999-b8ab-60e593a86e58 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:03.799309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e17329-767e-4771-b049-0e917549f7f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:03.799886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e17329-767e-4771-b049-0e917549f7f0 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:03.800173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e17329-767e-4771-b049-0e917549f7f0 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:03.800449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e17329-767e-4771-b049-0e917549f7f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:03.809949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e17329-767e-4771-b049-0e917549f7f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:03.838947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e17329-767e-4771-b049-0e917549f7f0 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:03.849345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 693/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:05.285553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a50c-98a2-4742-a777-f601a71f28a6 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:05.286065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a50c-98a2-4742-a777-f601a71f28a6 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:05.286065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a50c-98a2-4742-a777-f601a71f28a6 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:05.287802 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 693/1386] 10.222.0.36 () {54 vars in 911 bytes} [Wed Oct 27 14:06:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:05.292452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b0964-ae26-44d7-963d-42521d8ba95f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:05.292895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b0964-ae26-44d7-963d-42521d8ba95f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:05.292996 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b0964-ae26-44d7-963d-42521d8ba95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:05.315844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-314b0964-ae26-44d7-963d-42521d8ba95f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:05.317006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-314b0964-ae26-44d7-963d-42521d8ba95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:05.324056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 694/1387] 10.222.0.36 () {58 vars in 1008 bytes} [Wed Oct 27 14:06:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:05.475334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a50c-98a2-4742-a777-f601a71f28a6 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:05.489650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a50c-98a2-4742-a777-f601a71f28a6 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:05.494571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe545cd-9bcd-41fa-b13c-aab8661208cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:05.495184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe545cd-9bcd-41fa-b13c-aab8661208cb service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:05.495476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe545cd-9bcd-41fa-b13c-aab8661208cb service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:05.495763 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe545cd-9bcd-41fa-b13c-aab8661208cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:05.503847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe545cd-9bcd-41fa-b13c-aab8661208cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:05.528928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe545cd-9bcd-41fa-b13c-aab8661208cb service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:05.538689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 694/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:06.954914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cbb21-0252-4d9e-a7b3-2e5d2164c5d0 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:06.955575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cbb21-0252-4d9e-a7b3-2e5d2164c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:06.955575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cbb21-0252-4d9e-a7b3-2e5d2164c5d0 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:06.957149 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 695/1389] 10.222.0.36 () {54 vars in 911 bytes} [Wed Oct 27 14:06:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:06.961862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ff89-e8bd-47c5-b52b-8601bb4aa32d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:06.962285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ff89-e8bd-47c5-b52b-8601bb4aa32d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:06.962422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ff89-e8bd-47c5-b52b-8601bb4aa32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:06.984922 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2f97ff89-e8bd-47c5-b52b-8601bb4aa32d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:06.986183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2f97ff89-e8bd-47c5-b52b-8601bb4aa32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:06.993521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 695/1390] 10.222.0.36 () {58 vars in 1008 bytes} [Wed Oct 27 14:06:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:07.141217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cbb21-0252-4d9e-a7b3-2e5d2164c5d0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:07.155019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cbb21-0252-4d9e-a7b3-2e5d2164c5d0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:07.159961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cb161-1456-4afd-8157-2de0c94f1dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:07.160558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cb161-1456-4afd-8157-2de0c94f1dc1 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:07.160881 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cb161-1456-4afd-8157-2de0c94f1dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:07.161164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cb161-1456-4afd-8157-2de0c94f1dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:07.169171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cb161-1456-4afd-8157-2de0c94f1dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:07.195572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cb161-1456-4afd-8157-2de0c94f1dc1 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:07.205050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 696/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:08.652145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db5a80-1d99-471c-9879-3586eec9cdc2 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:08.652753 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db5a80-1d99-471c-9879-3586eec9cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:08.652753 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db5a80-1d99-471c-9879-3586eec9cdc2 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:08.654378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 696/1392] 10.222.0.36 () {54 vars in 911 bytes} [Wed Oct 27 14:06:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:08.659363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d220d-dfb6-4e50-9848-616301186831 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:08.659801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d220d-dfb6-4e50-9848-616301186831 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:08.660001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d220d-dfb6-4e50-9848-616301186831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:08.682782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-487d220d-dfb6-4e50-9848-616301186831 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:08.683926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-487d220d-dfb6-4e50-9848-616301186831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:08.691456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 697/1393] 10.222.0.36 () {58 vars in 1008 bytes} [Wed Oct 27 14:06:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:08.844716 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db5a80-1d99-471c-9879-3586eec9cdc2 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:08.858839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db5a80-1d99-471c-9879-3586eec9cdc2 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:08.864692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61863b-e067-4259-b888-daa0dc1048bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:08.865271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61863b-e067-4259-b888-daa0dc1048bf service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:08.865564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61863b-e067-4259-b888-daa0dc1048bf service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:08.865848 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61863b-e067-4259-b888-daa0dc1048bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:08.873690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61863b-e067-4259-b888-daa0dc1048bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:08.900040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61863b-e067-4259-b888-daa0dc1048bf service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:08.910158 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 697/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:10.287231 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a9b58-9fc3-4bc4-bf23-3c5ddbb00d02 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:10.287801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a9b58-9fc3-4bc4-bf23-3c5ddbb00d02 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:10.287801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a9b58-9fc3-4bc4-bf23-3c5ddbb00d02 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:10.289469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 698/1395] 10.222.0.36 () {54 vars in 911 bytes} [Wed Oct 27 14:06:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:10.294414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206385d3-106b-4678-9ca1-b3d90f3fd2ce None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:10.294871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206385d3-106b-4678-9ca1-b3d90f3fd2ce None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:10.295026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206385d3-106b-4678-9ca1-b3d90f3fd2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:10.318301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-206385d3-106b-4678-9ca1-b3d90f3fd2ce None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:10.319597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-206385d3-106b-4678-9ca1-b3d90f3fd2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:10.326570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 698/1396] 10.222.0.36 () {58 vars in 1008 bytes} [Wed Oct 27 14:06:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:10.476496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a9b58-9fc3-4bc4-bf23-3c5ddbb00d02 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:10.490833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a9b58-9fc3-4bc4-bf23-3c5ddbb00d02 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:10.495576 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31660335-3214-4d6c-b5ab-71ae6b7ac144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:10.496141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660335-3214-4d6c-b5ab-71ae6b7ac144 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:10.496442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660335-3214-4d6c-b5ab-71ae6b7ac144 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:10.496703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660335-3214-4d6c-b5ab-71ae6b7ac144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:10.505062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31660335-3214-4d6c-b5ab-71ae6b7ac144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:10.529867 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31660335-3214-4d6c-b5ab-71ae6b7ac144 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:10.539642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 699/1397] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:11.897410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36757ecf-1720-4169-bb6e-f9283ad3f144 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:11.897977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36757ecf-1720-4169-bb6e-f9283ad3f144 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:11.897977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36757ecf-1720-4169-bb6e-f9283ad3f144 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:11.899678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 699/1398] 10.222.0.36 () {54 vars in 911 bytes} [Wed Oct 27 14:06:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:11.904474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a2c5c-19fb-4864-9e35-4da55f19d08c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:11.904923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a2c5c-19fb-4864-9e35-4da55f19d08c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:11.905073 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a2c5c-19fb-4864-9e35-4da55f19d08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:11.927602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c81a2c5c-19fb-4864-9e35-4da55f19d08c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:11.928765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c81a2c5c-19fb-4864-9e35-4da55f19d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:11.935529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 700/1399] 10.222.0.36 () {58 vars in 1008 bytes} [Wed Oct 27 14:06:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:12.084806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36757ecf-1720-4169-bb6e-f9283ad3f144 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:12.099131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36757ecf-1720-4169-bb6e-f9283ad3f144 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:12.104048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda71ef8-9cde-4643-a8af-2ecd2c8deef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:12.104625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda71ef8-9cde-4643-a8af-2ecd2c8deef4 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:12.104917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda71ef8-9cde-4643-a8af-2ecd2c8deef4 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:12.105201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda71ef8-9cde-4643-a8af-2ecd2c8deef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:12.114646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda71ef8-9cde-4643-a8af-2ecd2c8deef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:12.140008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda71ef8-9cde-4643-a8af-2ecd2c8deef4 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:12.149828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 700/1400] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:13.490393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96061d62-5afb-4f22-95d0-80465d3b59de None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:13.490961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96061d62-5afb-4f22-95d0-80465d3b59de None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:13.490961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96061d62-5afb-4f22-95d0-80465d3b59de None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:13.492639 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 701/1401] 10.222.0.36 () {54 vars in 911 bytes} [Wed Oct 27 14:06:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:13.497491 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d656242-e091-46ee-b591-38f4263866df None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:13.497894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d656242-e091-46ee-b591-38f4263866df None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:13.498066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d656242-e091-46ee-b591-38f4263866df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:13.520413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2d656242-e091-46ee-b591-38f4263866df None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:13.521547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2d656242-e091-46ee-b591-38f4263866df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:13.528392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 701/1402] 10.222.0.36 () {58 vars in 1008 bytes} [Wed Oct 27 14:06:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:13.674996 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96061d62-5afb-4f22-95d0-80465d3b59de None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:13.687979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96061d62-5afb-4f22-95d0-80465d3b59de None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:13.692861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba4d9f-094f-49e9-b1b9-56178d9b6fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:13.693422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4d9f-094f-49e9-b1b9-56178d9b6fb0 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:13.693706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4d9f-094f-49e9-b1b9-56178d9b6fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:13.693985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4d9f-094f-49e9-b1b9-56178d9b6fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:13.701753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba4d9f-094f-49e9-b1b9-56178d9b6fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:13.727210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba4d9f-094f-49e9-b1b9-56178d9b6fb0 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:13.736148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 702/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:15.100152 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a61c-109c-4b3b-a1e0-23a3cef10924 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:15.100710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a61c-109c-4b3b-a1e0-23a3cef10924 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:15.100710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a61c-109c-4b3b-a1e0-23a3cef10924 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:15.102396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 702/1404] 10.222.0.36 () {54 vars in 911 bytes} [Wed Oct 27 14:06:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:15.107256 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65b352-17e2-4949-9185-d148074594a7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:15.107662 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65b352-17e2-4949-9185-d148074594a7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:15.107822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65b352-17e2-4949-9185-d148074594a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:15.130486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7f65b352-17e2-4949-9185-d148074594a7 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:15.131648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7f65b352-17e2-4949-9185-d148074594a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:15.138374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 703/1405] 10.222.0.36 () {58 vars in 1008 bytes} [Wed Oct 27 14:06:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:15.287487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a61c-109c-4b3b-a1e0-23a3cef10924 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:15.300806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a61c-109c-4b3b-a1e0-23a3cef10924 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:15.305603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1bb06-3e1d-406e-b315-cea49c30a11f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:15.306180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1bb06-3e1d-406e-b315-cea49c30a11f service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:15.306474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1bb06-3e1d-406e-b315-cea49c30a11f service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:15.306796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1bb06-3e1d-406e-b315-cea49c30a11f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:15.315391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1bb06-3e1d-406e-b315-cea49c30a11f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:15.341325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1bb06-3e1d-406e-b315-cea49c30a11f service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:15.350441 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 703/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:17.288530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a5a5d-0b39-4d49-9205-414afa77cdf6 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:17.289072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a5a5d-0b39-4d49-9205-414afa77cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:17.289072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a5a5d-0b39-4d49-9205-414afa77cdf6 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:17.290717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 704/1407] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:17.296107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274610-f715-4795-bd2e-62e7a1f475d3 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:17.296560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274610-f715-4795-bd2e-62e7a1f475d3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:17.296690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274610-f715-4795-bd2e-62e7a1f475d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:17.319661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-45274610-f715-4795-bd2e-62e7a1f475d3 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:17.320795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-45274610-f715-4795-bd2e-62e7a1f475d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:17.327650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 704/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:17.366889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a5a5d-0b39-4d49-9205-414afa77cdf6 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:17.377376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a5a5d-0b39-4d49-9205-414afa77cdf6 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:17.380775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf5d09-2a80-48ec-b9bf-923432af8030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:17.381329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf5d09-2a80-48ec-b9bf-923432af8030 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:17.381622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf5d09-2a80-48ec-b9bf-923432af8030 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:17.381906 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf5d09-2a80-48ec-b9bf-923432af8030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:17.390717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf5d09-2a80-48ec-b9bf-923432af8030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:17.416965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf5d09-2a80-48ec-b9bf-923432af8030 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:17.427077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 705/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:19.538986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b450-185a-41a1-8e92-4d0008f616f4 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:19.539518 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b450-185a-41a1-8e92-4d0008f616f4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:19.539634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b450-185a-41a1-8e92-4d0008f616f4 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:19.541267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 705/1410] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:19.547016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfcfbb-e6e3-4d5e-a19b-4352469955d5 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:19.547450 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfcfbb-e6e3-4d5e-a19b-4352469955d5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:19.547584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfcfbb-e6e3-4d5e-a19b-4352469955d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:19.572665 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b1bfcfbb-e6e3-4d5e-a19b-4352469955d5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:19.573824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b1bfcfbb-e6e3-4d5e-a19b-4352469955d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:19.581559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 706/1411] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:19.619040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60b450-185a-41a1-8e92-4d0008f616f4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:19.630314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60b450-185a-41a1-8e92-4d0008f616f4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:19.633664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989897ac-385b-44e4-a251-839b20224ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:19.634269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989897ac-385b-44e4-a251-839b20224ceb service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:19.634532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989897ac-385b-44e4-a251-839b20224ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:19.634840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989897ac-385b-44e4-a251-839b20224ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:19.643994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989897ac-385b-44e4-a251-839b20224ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:19.668893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989897ac-385b-44e4-a251-839b20224ceb service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:19.678258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 706/1412] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:22.146667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb6098-e784-439d-bef4-958a4b1866e5 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:22.147228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb6098-e784-439d-bef4-958a4b1866e5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:22.147228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb6098-e784-439d-bef4-958a4b1866e5 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:22.148955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 707/1413] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:22.154266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2738e-b4ea-400b-bc4c-9c7974a7881b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:22.154715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2738e-b4ea-400b-bc4c-9c7974a7881b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:22.154873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2738e-b4ea-400b-bc4c-9c7974a7881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:22.177531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-23a2738e-b4ea-400b-bc4c-9c7974a7881b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:22.178694 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-23a2738e-b4ea-400b-bc4c-9c7974a7881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:22.185578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 707/1414] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:22.225478 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb6098-e784-439d-bef4-958a4b1866e5 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:22.236102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb6098-e784-439d-bef4-958a4b1866e5 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:22.239615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58e6b1-13b8-43a9-bf74-d403fd1628eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:22.240216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e6b1-13b8-43a9-bf74-d403fd1628eb service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:22.240508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e6b1-13b8-43a9-bf74-d403fd1628eb service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:22.240793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58e6b1-13b8-43a9-bf74-d403fd1628eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:22.249474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58e6b1-13b8-43a9-bf74-d403fd1628eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:22.275233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58e6b1-13b8-43a9-bf74-d403fd1628eb service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:22.285358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 708/1415] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:24.376301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32062a-3f65-4c9f-9a5e-9553bdd9de65 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:24.376819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32062a-3f65-4c9f-9a5e-9553bdd9de65 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:24.376929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32062a-3f65-4c9f-9a5e-9553bdd9de65 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:24.379540 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 708/1416] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 14:06:24.384800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2bba-ecdf-42b3-a2db-9dc290e3377a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:24.385236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2bba-ecdf-42b3-a2db-9dc290e3377a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:24.385376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2bba-ecdf-42b3-a2db-9dc290e3377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:24.407732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e04f2bba-ecdf-42b3-a2db-9dc290e3377a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:24.409520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e04f2bba-ecdf-42b3-a2db-9dc290e3377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:24.416951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 709/1417] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:24.456163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32062a-3f65-4c9f-9a5e-9553bdd9de65 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:24.457977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-bd32062a-3f65-4c9f-9a5e-9553bdd9de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:24.470093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32062a-3f65-4c9f-9a5e-9553bdd9de65 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:24.473796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770db44-c744-4ad1-b6b7-f464fe0b6fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:24.474370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770db44-c744-4ad1-b6b7-f464fe0b6fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:24.474691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770db44-c744-4ad1-b6b7-f464fe0b6fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:24.474976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770db44-c744-4ad1-b6b7-f464fe0b6fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:24.483467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770db44-c744-4ad1-b6b7-f464fe0b6fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:24.509520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770db44-c744-4ad1-b6b7-f464fe0b6fe2 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:24.519622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 709/1418] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:26.982324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32ace-9146-4291-bca3-af5e17a0c9fe None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:26.982895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32ace-9146-4291-bca3-af5e17a0c9fe None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:26.983025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32ace-9146-4291-bca3-af5e17a0c9fe None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:26.984608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 710/1419] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:26.994687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a7e7-239b-41a1-b8ad-a01b91616e4d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:26.995215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a7e7-239b-41a1-b8ad-a01b91616e4d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:26.995332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a7e7-239b-41a1-b8ad-a01b91616e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:27.024788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0237a7e7-239b-41a1-b8ad-a01b91616e4d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:27.026055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0237a7e7-239b-41a1-b8ad-a01b91616e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:27.033773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 710/1420] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:27.075767 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a32ace-9146-4291-bca3-af5e17a0c9fe None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:27.086912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a32ace-9146-4291-bca3-af5e17a0c9fe None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:27.090121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ea3bd-bbfa-43d2-aca0-5defc4dac82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:27.090737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea3bd-bbfa-43d2-aca0-5defc4dac82d service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:27.091021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea3bd-bbfa-43d2-aca0-5defc4dac82d service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:27.091311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea3bd-bbfa-43d2-aca0-5defc4dac82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:27.101405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ea3bd-bbfa-43d2-aca0-5defc4dac82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:27.128299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ea3bd-bbfa-43d2-aca0-5defc4dac82d service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:27.138197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 711/1421] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:29.298534 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431f922-0944-4bf1-857b-7f76851965a5 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:29.300314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431f922-0944-4bf1-857b-7f76851965a5 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:29.300314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431f922-0944-4bf1-857b-7f76851965a5 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:29.301562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 711/1422] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:29.306728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801e112-b40b-4a62-9f9b-e204667aab10 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:29.307217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801e112-b40b-4a62-9f9b-e204667aab10 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:29.307319 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801e112-b40b-4a62-9f9b-e204667aab10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:29.331664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-2801e112-b40b-4a62-9f9b-e204667aab10 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:29.332823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2801e112-b40b-4a62-9f9b-e204667aab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:29.339777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 712/1423] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:29.379278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431f922-0944-4bf1-857b-7f76851965a5 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:29.389493 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431f922-0944-4bf1-857b-7f76851965a5 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:29.392708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bedc05-e3ee-41b7-9852-11f8dfdf86c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:29.393276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bedc05-e3ee-41b7-9852-11f8dfdf86c9 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:29.393564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bedc05-e3ee-41b7-9852-11f8dfdf86c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:29.393843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bedc05-e3ee-41b7-9852-11f8dfdf86c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:29.402810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bedc05-e3ee-41b7-9852-11f8dfdf86c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:29.428602 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bedc05-e3ee-41b7-9852-11f8dfdf86c9 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:29.437783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 712/1424] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:06:31.582476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466762e1-4a42-4bbc-a527-ddf18fd3b0bf None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:31.583075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466762e1-4a42-4bbc-a527-ddf18fd3b0bf None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:31.583075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466762e1-4a42-4bbc-a527-ddf18fd3b0bf None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:31.584753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 713/1425] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:31.590131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7393a2-8c2b-40fa-89f2-c0f5445e0af9 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:31.590573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7393a2-8c2b-40fa-89f2-c0f5445e0af9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:31.590752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7393a2-8c2b-40fa-89f2-c0f5445e0af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:31.613888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-fa7393a2-8c2b-40fa-89f2-c0f5445e0af9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:31.615049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fa7393a2-8c2b-40fa-89f2-c0f5445e0af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:31.621879 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 713/1426] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:06:31.659221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466762e1-4a42-4bbc-a527-ddf18fd3b0bf None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:31.669501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466762e1-4a42-4bbc-a527-ddf18fd3b0bf None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:31.672661 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e31a49-0af6-41d0-8756-44c712e527fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:31.673230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e31a49-0af6-41d0-8756-44c712e527fe service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:31.673515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e31a49-0af6-41d0-8756-44c712e527fe service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:31.674297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e31a49-0af6-41d0-8756-44c712e527fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:31.683589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e31a49-0af6-41d0-8756-44c712e527fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:31.709402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e31a49-0af6-41d0-8756-44c712e527fe service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:31.718735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 714/1427] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:33.749162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99526612-c8e1-4004-8787-c71b4722a761 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:33.749683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99526612-c8e1-4004-8787-c71b4722a761 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:33.749683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99526612-c8e1-4004-8787-c71b4722a761 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:33.751353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 714/1428] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:33.756648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20b0a-40b7-4d8e-95fb-9e2c163b6cc0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:33.757065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20b0a-40b7-4d8e-95fb-9e2c163b6cc0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:33.757227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20b0a-40b7-4d8e-95fb-9e2c163b6cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:33.787379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-fee20b0a-40b7-4d8e-95fb-9e2c163b6cc0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:33.788543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fee20b0a-40b7-4d8e-95fb-9e2c163b6cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:33.795517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 715/1429] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:33.832431 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99526612-c8e1-4004-8787-c71b4722a761 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:33.842800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99526612-c8e1-4004-8787-c71b4722a761 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:33.846904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc686a7a-675e-4e3b-a9e3-70384f7acb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:33.847489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc686a7a-675e-4e3b-a9e3-70384f7acb47 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:33.847783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc686a7a-675e-4e3b-a9e3-70384f7acb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:33.848069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc686a7a-675e-4e3b-a9e3-70384f7acb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:33.857420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc686a7a-675e-4e3b-a9e3-70384f7acb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:33.882950 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc686a7a-675e-4e3b-a9e3-70384f7acb47 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:33.892151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 715/1430] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:35.952570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a58e-92cb-4197-8197-cdc45c2173a1 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:35.953105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a58e-92cb-4197-8197-cdc45c2173a1 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:35.953229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a58e-92cb-4197-8197-cdc45c2173a1 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:35.954851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 716/1431] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:35.960754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ba520-f6c8-4e02-93d6-d80a57ba6fc0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:35.961181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ba520-f6c8-4e02-93d6-d80a57ba6fc0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:35.961334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ba520-f6c8-4e02-93d6-d80a57ba6fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:35.984809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-761ba520-f6c8-4e02-93d6-d80a57ba6fc0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:35.985951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-761ba520-f6c8-4e02-93d6-d80a57ba6fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:35.993821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 716/1432] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:36.031973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a58e-92cb-4197-8197-cdc45c2173a1 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:36.042942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a58e-92cb-4197-8197-cdc45c2173a1 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:36.046168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be08411-7d35-4926-b87b-f5500494c253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:36.046782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be08411-7d35-4926-b87b-f5500494c253 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:36.047076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be08411-7d35-4926-b87b-f5500494c253 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:36.047362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be08411-7d35-4926-b87b-f5500494c253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:36.056327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be08411-7d35-4926-b87b-f5500494c253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:36.081675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be08411-7d35-4926-b87b-f5500494c253 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:36.091449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 717/1433] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:38.102180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f7b4e-0cc9-4155-b8a6-18b694ce40e0 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:38.102808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f7b4e-0cc9-4155-b8a6-18b694ce40e0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:38.102808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f7b4e-0cc9-4155-b8a6-18b694ce40e0 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:38.105012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 717/1434] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:38.110214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e055c-0d8a-43aa-9d4c-30a7a25cc945 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:38.110744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e055c-0d8a-43aa-9d4c-30a7a25cc945 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:38.110876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e055c-0d8a-43aa-9d4c-30a7a25cc945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:38.133502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-391e055c-0d8a-43aa-9d4c-30a7a25cc945 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:38.134644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-391e055c-0d8a-43aa-9d4c-30a7a25cc945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:38.141418 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 718/1435] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:38.177571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f7b4e-0cc9-4155-b8a6-18b694ce40e0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:38.188218 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f7b4e-0cc9-4155-b8a6-18b694ce40e0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:38.192278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfae27-a1ca-4aea-9d5c-07f112d3fcdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:38.192876 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfae27-a1ca-4aea-9d5c-07f112d3fcdc service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:38.193168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfae27-a1ca-4aea-9d5c-07f112d3fcdc service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:38.193456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfae27-a1ca-4aea-9d5c-07f112d3fcdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:38.203345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfae27-a1ca-4aea-9d5c-07f112d3fcdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:38.228944 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfae27-a1ca-4aea-9d5c-07f112d3fcdc service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:38.239301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 718/1436] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:50.029408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b8fe-7f5a-4b7a-858c-2fa6eb15c1a7 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:50.030441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b8fe-7f5a-4b7a-858c-2fa6eb15c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:50.031295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b8fe-7f5a-4b7a-858c-2fa6eb15c1a7 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:50.033188 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 719/1437] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:50.039219 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ebb9c-290a-40b8-978f-b0f83a871e8d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:50.039699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ebb9c-290a-40b8-978f-b0f83a871e8d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:50.039792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ebb9c-290a-40b8-978f-b0f83a871e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:50.065790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-b54ebb9c-290a-40b8-978f-b0f83a871e8d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:50.066965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b54ebb9c-290a-40b8-978f-b0f83a871e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:50.074142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 719/1438] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:06:50.120346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b8fe-7f5a-4b7a-858c-2fa6eb15c1a7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:50.131495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b8fe-7f5a-4b7a-858c-2fa6eb15c1a7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:50.134757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc421ee7-fe44-4c17-ab3d-28a67da898c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ddc229d1a0446c83956f9f0c1ddbfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:50.135327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421ee7-fe44-4c17-ab3d-28a67da898c8 service glance] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:50.135614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421ee7-fe44-4c17-ab3d-28a67da898c8 service glance] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:50.135895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421ee7-fe44-4c17-ab3d-28a67da898c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:50.145133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc421ee7-fe44-4c17-ab3d-28a67da898c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:50.170468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc421ee7-fe44-4c17-ab3d-28a67da898c8 service glance] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:50.180040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 720/1439] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:52.284794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca11c1f-340d-4fc7-b5ea-241baab854c8 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:52.285322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca11c1f-340d-4fc7-b5ea-241baab854c8 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:52.285322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca11c1f-340d-4fc7-b5ea-241baab854c8 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:52.287057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 720/1440] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:52.292372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f511e-5997-4c0c-9e0f-1355656a34a9 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:52.292791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f511e-5997-4c0c-9e0f-1355656a34a9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:52.292937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f511e-5997-4c0c-9e0f-1355656a34a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:52.315895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ed3f511e-5997-4c0c-9e0f-1355656a34a9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:52.317025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ed3f511e-5997-4c0c-9e0f-1355656a34a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:52.327096 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 721/1441] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:52.349557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca11c1f-340d-4fc7-b5ea-241baab854c8 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:52.362220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca11c1f-340d-4fc7-b5ea-241baab854c8 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:52.366603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b213-ab3c-455b-bd57-35fe469109f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:52.367221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b213-ab3c-455b-bd57-35fe469109f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:52.367511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b213-ab3c-455b-bd57-35fe469109f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:52.367796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b213-ab3c-455b-bd57-35fe469109f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:52.368492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9b213-ab3c-455b-bd57-35fe469109f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:52.394086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9b213-ab3c-455b-bd57-35fe469109f8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:52.409926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 721/1442] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Oct 27 14:06:52 2021] GET /identity/v3/projects => generated 2553 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:06:53.932376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0918b98-e445-4f68-8352-ed931efff0c0 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:53.932902 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0918b98-e445-4f68-8352-ed931efff0c0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:53.932990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0918b98-e445-4f68-8352-ed931efff0c0 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:53.934679 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 722/1443] 10.222.0.36 () {54 vars in 911 bytes} [Wed Oct 27 14:06:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:53.939643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709934-b057-4bd2-a159-7c302be450a0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:53.940075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709934-b057-4bd2-a159-7c302be450a0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:53.940256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709934-b057-4bd2-a159-7c302be450a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:53.962098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1b709934-b057-4bd2-a159-7c302be450a0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:53.963268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1b709934-b057-4bd2-a159-7c302be450a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:53.971177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 722/1444] 10.222.0.36 () {58 vars in 1008 bytes} [Wed Oct 27 14:06:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:06:54.118676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0918b98-e445-4f68-8352-ed931efff0c0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:54.132381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0918b98-e445-4f68-8352-ed931efff0c0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:54.137148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1a244-39e6-4577-a457-01730e22dd80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:54.137823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1a244-39e6-4577-a457-01730e22dd80 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:54.138114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1a244-39e6-4577-a457-01730e22dd80 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:54.138393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1a244-39e6-4577-a457-01730e22dd80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:54.146911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1a244-39e6-4577-a457-01730e22dd80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:54.172730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1a244-39e6-4577-a457-01730e22dd80 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:54.181876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 723/1445] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:56.238945 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778bd3-faef-4aa7-bf1f-dc27cbe561e3 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:56.239505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778bd3-faef-4aa7-bf1f-dc27cbe561e3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:56.239505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778bd3-faef-4aa7-bf1f-dc27cbe561e3 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:56.241168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 723/1446] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 14:06:56.246413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208bf6f-69a3-4242-8a75-b2225d3b9f4a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:56.246842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208bf6f-69a3-4242-8a75-b2225d3b9f4a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:56.247020 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208bf6f-69a3-4242-8a75-b2225d3b9f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:56.272324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e208bf6f-69a3-4242-8a75-b2225d3b9f4a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:56.273474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e208bf6f-69a3-4242-8a75-b2225d3b9f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:56.280490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 724/1447] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:56.317047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778bd3-faef-4aa7-bf1f-dc27cbe561e3 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:56.327385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778bd3-faef-4aa7-bf1f-dc27cbe561e3 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:56.331146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5024d-66ad-4963-bf45-7d34600e71ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:56.331723 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5024d-66ad-4963-bf45-7d34600e71ac service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:56.332526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5024d-66ad-4963-bf45-7d34600e71ac service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:56.332526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5024d-66ad-4963-bf45-7d34600e71ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:56.341202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5024d-66ad-4963-bf45-7d34600e71ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:56.374735 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5024d-66ad-4963-bf45-7d34600e71ac service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:56.384012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 724/1448] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:06:58.413219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781d6e6-52e3-4189-9235-43adad7be3d9 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:58.413790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781d6e6-52e3-4189-9235-43adad7be3d9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:58.413790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781d6e6-52e3-4189-9235-43adad7be3d9 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:58.415534 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 725/1449] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:06:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:06:58.420806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971c972-85f4-4259-ad1a-ad7da5993f1f None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:58.421195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971c972-85f4-4259-ad1a-ad7da5993f1f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:58.421375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971c972-85f4-4259-ad1a-ad7da5993f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:58.445015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3971c972-85f4-4259-ad1a-ad7da5993f1f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:06:58.446147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3971c972-85f4-4259-ad1a-ad7da5993f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:06:58.453075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 725/1450] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:06:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:06:58.493877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781d6e6-52e3-4189-9235-43adad7be3d9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:06:58.504693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781d6e6-52e3-4189-9235-43adad7be3d9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:06:58.507886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a2f84-8090-4547-9842-ff9be7fcbd73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:06:58.508451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a2f84-8090-4547-9842-ff9be7fcbd73 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:06:58.508736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a2f84-8090-4547-9842-ff9be7fcbd73 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:06:58.509013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a2f84-8090-4547-9842-ff9be7fcbd73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:06:58.518145 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a2f84-8090-4547-9842-ff9be7fcbd73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:06:58.543558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a2f84-8090-4547-9842-ff9be7fcbd73 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:06:58.552773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 726/1451] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:06:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:07:00.717419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87115a52-d8aa-4e56-92b5-03b17701c345 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:07:00.718036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87115a52-d8aa-4e56-92b5-03b17701c345 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:07:00.718036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87115a52-d8aa-4e56-92b5-03b17701c345 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:07:00.719708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 726/1452] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:07:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:07:00.725218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290945ab-5b50-47a9-9244-47e50434f486 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:07:00.725993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290945ab-5b50-47a9-9244-47e50434f486 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:07:00.726279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290945ab-5b50-47a9-9244-47e50434f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:07:00.749261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-290945ab-5b50-47a9-9244-47e50434f486 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:07:00.750408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-290945ab-5b50-47a9-9244-47e50434f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:07:00.758253 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 727/1453] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:07:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:07:00.799484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87115a52-d8aa-4e56-92b5-03b17701c345 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:07:00.810207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87115a52-d8aa-4e56-92b5-03b17701c345 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:07:00.813525 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb509e7-2468-40e5-9754-51cd7acad833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:07:00.814684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb509e7-2468-40e5-9754-51cd7acad833 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:07:00.814976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb509e7-2468-40e5-9754-51cd7acad833 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:07:00.815257 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb509e7-2468-40e5-9754-51cd7acad833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:07:00.824405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb509e7-2468-40e5-9754-51cd7acad833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:07:00.849446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb509e7-2468-40e5-9754-51cd7acad833 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:07:00.859189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 727/1454] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:07:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:07:03.181364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1d7fc-34a3-4cb8-b3ec-fecfa4f257a4 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:07:03.181923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1d7fc-34a3-4cb8-b3ec-fecfa4f257a4 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:07:03.181923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1d7fc-34a3-4cb8-b3ec-fecfa4f257a4 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:07:03.183647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 728/1455] 10.222.0.36 () {54 vars in 926 bytes} [Wed Oct 27 14:07:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:07:03.189395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fd8d7-9b36-47e0-aa4d-cd4556c03e7e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:07:03.189833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fd8d7-9b36-47e0-aa4d-cd4556c03e7e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:07:03.190056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fd8d7-9b36-47e0-aa4d-cd4556c03e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:07:03.212589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-ea5fd8d7-9b36-47e0-aa4d-cd4556c03e7e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:07:03.213720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ea5fd8d7-9b36-47e0-aa4d-cd4556c03e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:07:03.220804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 728/1456] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Oct 27 14:07:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:07:03.259946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1d7fc-34a3-4cb8-b3ec-fecfa4f257a4 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:07:03.270183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1d7fc-34a3-4cb8-b3ec-fecfa4f257a4 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:07:03.273328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c14d-fa1a-4a0e-8aa6-1be528f48671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:07:03.273885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c14d-fa1a-4a0e-8aa6-1be528f48671 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:07:03.274169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c14d-fa1a-4a0e-8aa6-1be528f48671 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:07:03.274444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c14d-fa1a-4a0e-8aa6-1be528f48671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:07:03.283114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0c14d-fa1a-4a0e-8aa6-1be528f48671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:07:03.308222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0c14d-fa1a-4a0e-8aa6-1be528f48671 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:07:03.318414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 729/1457] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:07:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:08:05.794696 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccb55f-744b-4e61-8921-3c843af8a6f4 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:05.795258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccb55f-744b-4e61-8921-3c843af8a6f4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:05.795258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccb55f-744b-4e61-8921-3c843af8a6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:05.818379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-deccb55f-744b-4e61-8921-3c843af8a6f4 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:08:05.819622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-deccb55f-744b-4e61-8921-3c843af8a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:08:05.826846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 729/1458] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:08:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:08:05.835353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b96d2-7076-413d-9a51-d47438c856de None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:05.835893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b96d2-7076-413d-9a51-d47438c856de None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:05.836011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b96d2-7076-413d-9a51-d47438c856de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:05.861705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-797b96d2-7076-413d-9a51-d47438c856de None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:08:05.862925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-797b96d2-7076-413d-9a51-d47438c856de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:08:05.870138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 730/1459] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:08:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:08:05.874935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccb55f-744b-4e61-8921-3c843af8a6f4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:08:05.885074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccb55f-744b-4e61-8921-3c843af8a6f4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:08:05.889152 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb4a2-4462-44af-b137-84b55fdb32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:08:05.889731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb4a2-4462-44af-b137-84b55fdb32e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:05.890024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb4a2-4462-44af-b137-84b55fdb32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:05.890423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cb4a2-4462-44af-b137-84b55fdb32e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:05.891181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb4a2-4462-44af-b137-84b55fdb32e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:08:05.891482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb4a2-4462-44af-b137-84b55fdb32e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:08:05.916917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cb4a2-4462-44af-b137-84b55fdb32e4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:08:05.930892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 730/1460] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:08:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:08:05.939518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b96d2-7076-413d-9a51-d47438c856de None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:08:05.948397 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b96d2-7076-413d-9a51-d47438c856de None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:08:05.952640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ee4b9-af9d-4bcc-94d0-8721793ff6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:08:05.953238 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ee4b9-af9d-4bcc-94d0-8721793ff6ac admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:05.953529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ee4b9-af9d-4bcc-94d0-8721793ff6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:05.953857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ee4b9-af9d-4bcc-94d0-8721793ff6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:05.954504 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ee4b9-af9d-4bcc-94d0-8721793ff6ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:08:05.980603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ee4b9-af9d-4bcc-94d0-8721793ff6ac admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:08:06.024347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 731/1461] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:08:05 2021] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:08:06.028593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb4a2-4462-44af-b137-84b55fdb32e4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:08:06.039171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cb4a2-4462-44af-b137-84b55fdb32e4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:08:06.100302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afded43-8ab0-4b1e-8283-bbec88780b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:08:06.100899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afded43-8ab0-4b1e-8283-bbec88780b28 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:06.101230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afded43-8ab0-4b1e-8283-bbec88780b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:06.101512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afded43-8ab0-4b1e-8283-bbec88780b28 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:06.102144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afded43-8ab0-4b1e-8283-bbec88780b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:08:06.129644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afded43-8ab0-4b1e-8283-bbec88780b28 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:08:06.151924 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 731/1462] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:08:06 2021] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:08:06.156848 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ee4b9-af9d-4bcc-94d0-8721793ff6ac admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:08:06.166481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ee4b9-af9d-4bcc-94d0-8721793ff6ac admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:08:06.170796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8476f15-0c71-4e42-a8a0-a5e460fe2fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:08:06.171382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476f15-0c71-4e42-a8a0-a5e460fe2fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:06.171757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476f15-0c71-4e42-a8a0-a5e460fe2fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:06.172112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8476f15-0c71-4e42-a8a0-a5e460fe2fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:06.172803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8476f15-0c71-4e42-a8a0-a5e460fe2fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:08:06.197699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8476f15-0c71-4e42-a8a0-a5e460fe2fe2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:08:06.208612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 732/1463] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:08:06 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:08:06.212858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afded43-8ab0-4b1e-8283-bbec88780b28 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:08:06.222832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afded43-8ab0-4b1e-8283-bbec88780b28 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:08:06.227048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b60894-76b8-4557-85aa-e9d3930a01c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:08:06.227902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b60894-76b8-4557-85aa-e9d3930a01c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:06.228194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b60894-76b8-4557-85aa-e9d3930a01c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:06.228482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b60894-76b8-4557-85aa-e9d3930a01c8 admin admin] PATH_INFO: `/v3/projects/4abf04b6b1c7465ab175d8e393728922/users/bb2d5431fb4e4ec0b783745c024cdf99/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:06.248498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b60894-76b8-4557-85aa-e9d3930a01c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abf04b6b1c7465ab175d8e393728922, user_id=bb2d5431fb4e4ec0b783745c024cdf99, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:08:06.275064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b60894-76b8-4557-85aa-e9d3930a01c8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:08:06.288454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 732/1464] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:08:06 2021] PUT /identity/v3/projects/4abf04b6b1c7465ab175d8e393728922/users/bb2d5431fb4e4ec0b783745c024cdf99/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:08:06.300886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed55a3-8520-470e-b3bc-e9e6947009c9 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:06.301186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed55a3-8520-470e-b3bc-e9e6947009c9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:06.301476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed55a3-8520-470e-b3bc-e9e6947009c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:06.337417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-75ed55a3-8520-470e-b3bc-e9e6947009c9 None None] MFA Rules not processed for user `bb2d5431fb4e4ec0b783745c024cdf99`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:08:06.338571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-75ed55a3-8520-470e-b3bc-e9e6947009c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:08:06.411518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 733/1465] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:08:06 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:08:06.421984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b60894-76b8-4557-85aa-e9d3930a01c8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:08:06.499461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b60894-76b8-4557-85aa-e9d3930a01c8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:08:06.505168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c59231-ceb3-4ea4-9937-ea632779f37e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:08:06.505750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c59231-ceb3-4ea4-9937-ea632779f37e service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:06.506040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c59231-ceb3-4ea4-9937-ea632779f37e service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:06.506323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c59231-ceb3-4ea4-9937-ea632779f37e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:06.513904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c59231-ceb3-4ea4-9937-ea632779f37e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:08:06.540043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c59231-ceb3-4ea4-9937-ea632779f37e service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:08:06.548982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 733/1466] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:08:06 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:08:06.626649 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39618f5-7780-4a33-a2f3-64bcb5c2bd00 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:06.626965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39618f5-7780-4a33-a2f3-64bcb5c2bd00 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:06.627402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39618f5-7780-4a33-a2f3-64bcb5c2bd00 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:06.629139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 734/1467] 10.222.0.36 () {52 vars in 829 bytes} [Wed Oct 27 14:08:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:08:06.632690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c59231-ceb3-4ea4-9937-ea632779f37e service nova] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:08:06.703317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c59231-ceb3-4ea4-9937-ea632779f37e service nova] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:08:06.707629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:08:06.708437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:06.708726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:06.709052 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] PATH_INFO: `/v3/users/bb2d5431fb4e4ec0b783745c024cdf99` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:06.710341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2d5431fb4e4ec0b783745c024cdf99)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:08:06.734976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:06.734976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 14:08:06.734976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 14:08:06.736182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:08:06.797408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2d5431fb4e4ec0b783745c024cdf99'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:06.818063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2d5431fb4e4ec0b783745c024cdf99'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:06.818900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2d5431fb4e4ec0b783745c024cdf99'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:06.829617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2d5431fb4e4ec0b783745c024cdf99'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:06.838268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2d5431fb4e4ec0b783745c024cdf99'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:06.844512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 734/1468] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:08:06 2021] DELETE /identity/v3/users/bb2d5431fb4e4ec0b783745c024cdf99 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:08:06.848904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61af71-cbe6-467a-82c2-e5dd3bd85875 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:06.849379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61af71-cbe6-467a-82c2-e5dd3bd85875 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:06.849473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61af71-cbe6-467a-82c2-e5dd3bd85875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:06.871538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-cc61af71-cbe6-467a-82c2-e5dd3bd85875 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:08:06.872681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cc61af71-cbe6-467a-82c2-e5dd3bd85875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:08:06.937904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 735/1469] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:08:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:08:06.948120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:08:06.949538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:08:07.017658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbb78d-fc0d-48e6-8ecd-512a9856fe8f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:08:07.021566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f6623-d0f4-439e-a052-65e5e0408145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:08:07.022160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f6623-d0f4-439e-a052-65e5e0408145 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:07.022443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f6623-d0f4-439e-a052-65e5e0408145 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:07.022828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f6623-d0f4-439e-a052-65e5e0408145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:07.033327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f6623-d0f4-439e-a052-65e5e0408145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:08:07.060317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f6623-d0f4-439e-a052-65e5e0408145 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:08:07.069905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 735/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:08:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:08:07.503824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61af71-cbe6-467a-82c2-e5dd3bd85875 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:08:07.505803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cc61af71-cbe6-467a-82c2-e5dd3bd85875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:08:07.517504 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61af71-cbe6-467a-82c2-e5dd3bd85875 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:08:07.522659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:08:07.523506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:08:07.523707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:08:07.523986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] PATH_INFO: `/v3/projects/4abf04b6b1c7465ab175d8e393728922` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:08:07.525054 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abf04b6b1c7465ab175d8e393728922)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:08:07.549689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:07.549689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 14:08:07.549689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 14:08:07.550883 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:08:07.607388 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abf04b6b1c7465ab175d8e393728922', 'request_id': 'req-b5f4c3e9-acd1-4ee4-b563-750196fb8376'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:07.619354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abf04b6b1c7465ab175d8e393728922', 'request_id': 'req-b5f4c3e9-acd1-4ee4-b563-750196fb8376'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:07.628046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abf04b6b1c7465ab175d8e393728922', 'request_id': 'req-b5f4c3e9-acd1-4ee4-b563-750196fb8376'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:07.638023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] The token cache is being invalidate because project 4abf04b6b1c7465ab175d8e393728922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:08:07.638304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:07.638982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b5f4c3e9-acd1-4ee4-b563-750196fb8376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:08:07.640424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 736/1471] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:08:07 2021] DELETE /identity/v3/projects/4abf04b6b1c7465ab175d8e393728922 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:09:37.659149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b34d1-957e-41ae-9caf-a2d3f7fe975f None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:37.659760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b34d1-957e-41ae-9caf-a2d3f7fe975f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:37.659760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b34d1-957e-41ae-9caf-a2d3f7fe975f None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:37.661361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 736/1472] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 14:09:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:09:37.666221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817bea8-79e5-47af-8826-9dd540993ae8 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:37.666705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817bea8-79e5-47af-8826-9dd540993ae8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:37.666845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817bea8-79e5-47af-8826-9dd540993ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:37.693493 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-1817bea8-79e5-47af-8826-9dd540993ae8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:09:37.696239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1817bea8-79e5-47af-8826-9dd540993ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:37.762823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 737/1473] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 14:09:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:09:37.915477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b34d1-957e-41ae-9caf-a2d3f7fe975f None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:09:37.917364 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-036b34d1-957e-41ae-9caf-a2d3f7fe975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:38.005310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b34d1-957e-41ae-9caf-a2d3f7fe975f None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:09:38.010763 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411cfd5-05de-4451-a635-d668f74bab30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:09:38.011348 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411cfd5-05de-4451-a635-d668f74bab30 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:38.011636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411cfd5-05de-4451-a635-d668f74bab30 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:38.011915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411cfd5-05de-4451-a635-d668f74bab30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:38.020986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411cfd5-05de-4451-a635-d668f74bab30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:09:38.047915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411cfd5-05de-4451-a635-d668f74bab30 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:09:38.058474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 737/1474] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:09:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:09:38.245803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bbb5a-958d-46f4-8730-1a49efd22825 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:38.246096 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bbb5a-958d-46f4-8730-1a49efd22825 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:38.246382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bbb5a-958d-46f4-8730-1a49efd22825 None None] PATH_INFO: `/v3` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:38.247622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 738/1475] 10.222.0.79 () {54 vars in 925 bytes} [Wed Oct 27 14:09:38 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:09:38.254251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4185b-bdfd-4bfe-b175-44595dcca886 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:38.254651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4185b-bdfd-4bfe-b175-44595dcca886 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:38.254958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4185b-bdfd-4bfe-b175-44595dcca886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:38.281863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-28e4185b-bdfd-4bfe-b175-44595dcca886 None None] MFA Rules not processed for user `78404f52618b4d86a2a478f18b136773`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:09:38.282982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-28e4185b-bdfd-4bfe-b175-44595dcca886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:38.353841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 738/1476] 10.222.0.79 () {58 vars in 1015 bytes} [Wed Oct 27 14:09:38 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:09:39.449884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5416-6fe0-4e03-9c9b-81122f4d0e05 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:39.450465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5416-6fe0-4e03-9c9b-81122f4d0e05 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:39.450465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5416-6fe0-4e03-9c9b-81122f4d0e05 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:39.452349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 739/1477] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 14:09:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:09:39.457143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95d982-ca87-4855-9b24-6fb404d0f4c1 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:39.457591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95d982-ca87-4855-9b24-6fb404d0f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:39.457700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95d982-ca87-4855-9b24-6fb404d0f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:39.480024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-9a95d982-ca87-4855-9b24-6fb404d0f4c1 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:09:39.481149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9a95d982-ca87-4855-9b24-6fb404d0f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:39.488218 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 739/1478] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 14:09:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:09:39.638927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab5416-6fe0-4e03-9c9b-81122f4d0e05 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:09:39.653424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab5416-6fe0-4e03-9c9b-81122f4d0e05 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:09:39.657755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49564a-51cf-411d-9aeb-9d756d542104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:09:39.658327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49564a-51cf-411d-9aeb-9d756d542104 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:39.658614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49564a-51cf-411d-9aeb-9d756d542104 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:39.658920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49564a-51cf-411d-9aeb-9d756d542104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:39.668019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49564a-51cf-411d-9aeb-9d756d542104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:09:39.693969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49564a-51cf-411d-9aeb-9d756d542104 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:09:39.704874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 740/1479] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:09:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:09:42.172313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1530b3-c8b3-4c6f-a51c-8ce0ef84526d None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:42.172761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1530b3-c8b3-4c6f-a51c-8ce0ef84526d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:42.172974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1530b3-c8b3-4c6f-a51c-8ce0ef84526d None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:42.174651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 740/1480] 10.222.0.36 () {54 vars in 960 bytes} [Wed Oct 27 14:09:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:09:42.179571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566b22-2df4-4b85-a4ad-488eb39422c0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:42.180028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566b22-2df4-4b85-a4ad-488eb39422c0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:42.180129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566b22-2df4-4b85-a4ad-488eb39422c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:42.203238 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-fc566b22-2df4-4b85-a4ad-488eb39422c0 None None] MFA Rules not processed for user `78404f52618b4d86a2a478f18b136773`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:09:42.204393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fc566b22-2df4-4b85-a4ad-488eb39422c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:42.212454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 741/1481] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Oct 27 14:09:42 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:09:42.219942 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1530b3-c8b3-4c6f-a51c-8ce0ef84526d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:09:42.232830 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1530b3-c8b3-4c6f-a51c-8ce0ef84526d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:09:42.237230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afefbc-0dd1-4367-bc82-35a708fe1b89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:09:42.238036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afefbc-0dd1-4367-bc82-35a708fe1b89 service placement] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:42.238329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afefbc-0dd1-4367-bc82-35a708fe1b89 service placement] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:42.238613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afefbc-0dd1-4367-bc82-35a708fe1b89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:42.246460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afefbc-0dd1-4367-bc82-35a708fe1b89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:09:42.271461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afefbc-0dd1-4367-bc82-35a708fe1b89 service placement] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:09:42.281254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 741/1482] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:09:42 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:09:51.509201 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432afba-3fac-41f2-9914-f9c7eab92909 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:51.509931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432afba-3fac-41f2-9914-f9c7eab92909 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:51.509931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432afba-3fac-41f2-9914-f9c7eab92909 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:51.511391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 742/1483] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 14:09:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:09:51.516476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a896cd-a826-4fa6-8dcd-10b724a3ef37 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:51.516943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a896cd-a826-4fa6-8dcd-10b724a3ef37 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:51.517063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a896cd-a826-4fa6-8dcd-10b724a3ef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:51.540617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-56a896cd-a826-4fa6-8dcd-10b724a3ef37 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:09:51.541805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-56a896cd-a826-4fa6-8dcd-10b724a3ef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:51.548858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 742/1484] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 14:09:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:09:51.700457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432afba-3fac-41f2-9914-f9c7eab92909 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:09:51.720627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432afba-3fac-41f2-9914-f9c7eab92909 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:09:51.726273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c81e2-7740-48f0-a8bb-092edcdfc079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:09:51.726902 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c81e2-7740-48f0-a8bb-092edcdfc079 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:51.727197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c81e2-7740-48f0-a8bb-092edcdfc079 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:51.727487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c81e2-7740-48f0-a8bb-092edcdfc079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:51.737263 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c81e2-7740-48f0-a8bb-092edcdfc079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:09:51.763322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c81e2-7740-48f0-a8bb-092edcdfc079 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:09:51.773959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 743/1485] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:09:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:09:53.128474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c8857-4eac-4e20-96b6-9f66832ec513 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:53.129075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c8857-4eac-4e20-96b6-9f66832ec513 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:53.129075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c8857-4eac-4e20-96b6-9f66832ec513 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:53.130790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 14:09:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:09:53.135992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d43ca7-a6ed-4360-8b00-063358e99213 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:53.136429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d43ca7-a6ed-4360-8b00-063358e99213 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:53.136569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d43ca7-a6ed-4360-8b00-063358e99213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:53.159728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-66d43ca7-a6ed-4360-8b00-063358e99213 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:09:53.160874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-66d43ca7-a6ed-4360-8b00-063358e99213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:53.168011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 14:09:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:09:53.316474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c8857-4eac-4e20-96b6-9f66832ec513 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:09:53.330116 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c8857-4eac-4e20-96b6-9f66832ec513 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:09:53.335424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84896e1a-187e-47db-830b-9e168813e9b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:09:53.336000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896e1a-187e-47db-830b-9e168813e9b6 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:53.336318 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896e1a-187e-47db-830b-9e168813e9b6 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:53.336603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896e1a-187e-47db-830b-9e168813e9b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:53.344627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84896e1a-187e-47db-830b-9e168813e9b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:09:53.370385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84896e1a-187e-47db-830b-9e168813e9b6 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:09:53.379480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 744/1488] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:09:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:09:57.238329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab693e-8b80-4cd2-8125-80daf7417d34 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:57.238918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab693e-8b80-4cd2-8125-80daf7417d34 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:57.238918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab693e-8b80-4cd2-8125-80daf7417d34 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:57.240632 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 14:09:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:09:57.245874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43328f-0007-4667-b3a8-8ace2da0149b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:57.246422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43328f-0007-4667-b3a8-8ace2da0149b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:57.246422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43328f-0007-4667-b3a8-8ace2da0149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:57.268572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-bf43328f-0007-4667-b3a8-8ace2da0149b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:09:57.269685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-bf43328f-0007-4667-b3a8-8ace2da0149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:57.277192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 14:09:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:09:57.312760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab693e-8b80-4cd2-8125-80daf7417d34 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:09:57.314369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-41ab693e-8b80-4cd2-8125-80daf7417d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:57.378297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab693e-8b80-4cd2-8125-80daf7417d34 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:09:57.382131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78d973-2908-4ad4-ac3c-e2a41e294092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:09:57.382745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78d973-2908-4ad4-ac3c-e2a41e294092 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:57.383040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78d973-2908-4ad4-ac3c-e2a41e294092 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:57.383328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78d973-2908-4ad4-ac3c-e2a41e294092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:57.392142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78d973-2908-4ad4-ac3c-e2a41e294092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:09:57.418029 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78d973-2908-4ad4-ac3c-e2a41e294092 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:09:57.427529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 746/1491] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:09:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:09:59.448772 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e8c25-ef4a-4dd2-a915-d310c4c1b0c6 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:59.449359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e8c25-ef4a-4dd2-a915-d310c4c1b0c6 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:59.449359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e8c25-ef4a-4dd2-a915-d310c4c1b0c6 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:59.451042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 14:09:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:09:59.456119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c05a2f-6938-40cc-934b-48553bf32496 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:59.456528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c05a2f-6938-40cc-934b-48553bf32496 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:59.456729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c05a2f-6938-40cc-934b-48553bf32496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:59.479298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-69c05a2f-6938-40cc-934b-48553bf32496 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:09:59.480443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-69c05a2f-6938-40cc-934b-48553bf32496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:09:59.487639 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 14:09:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:09:59.525072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e8c25-ef4a-4dd2-a915-d310c4c1b0c6 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:09:59.535298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e8c25-ef4a-4dd2-a915-d310c4c1b0c6 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:09:59.539334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87ffaf-690e-4241-95ef-4ebc10e78b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:09:59.539906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87ffaf-690e-4241-95ef-4ebc10e78b73 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:09:59.540201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87ffaf-690e-4241-95ef-4ebc10e78b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:09:59.540485 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87ffaf-690e-4241-95ef-4ebc10e78b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:09:59.549016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87ffaf-690e-4241-95ef-4ebc10e78b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:09:59.574934 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87ffaf-690e-4241-95ef-4ebc10e78b73 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:09:59.584333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 747/1494] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:09:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:10:03.134407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3884791-ff78-4c5e-9183-dcda6581b2d9 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:10:03.134991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3884791-ff78-4c5e-9183-dcda6581b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:10:03.134991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3884791-ff78-4c5e-9183-dcda6581b2d9 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:10:03.136683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 14:10:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:10:03.141802 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e1c3d-9936-4128-bd50-65df24fae0bb None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:10:03.142233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e1c3d-9936-4128-bd50-65df24fae0bb None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:10:03.142371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e1c3d-9936-4128-bd50-65df24fae0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:10:03.164559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-b38e1c3d-9936-4128-bd50-65df24fae0bb None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:10:03.165709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b38e1c3d-9936-4128-bd50-65df24fae0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:10:03.172433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 14:10:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:10:03.230378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3884791-ff78-4c5e-9183-dcda6581b2d9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:10:03.231974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c3884791-ff78-4c5e-9183-dcda6581b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:10:03.295796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3884791-ff78-4c5e-9183-dcda6581b2d9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:10:03.299101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8f3f3-f93e-40b8-8add-90ef56f68cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:10:03.299608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8f3f3-f93e-40b8-8add-90ef56f68cda service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:10:03.299901 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8f3f3-f93e-40b8-8add-90ef56f68cda service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:10:03.300186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8f3f3-f93e-40b8-8add-90ef56f68cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:10:03.309446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8f3f3-f93e-40b8-8add-90ef56f68cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:10:03.334405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8f3f3-f93e-40b8-8add-90ef56f68cda service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:10:03.343652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 749/1497] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:10:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:10:05.349180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb180425-ab40-48d0-af93-a447b2743884 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:10:05.349834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb180425-ab40-48d0-af93-a447b2743884 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:10:05.349834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb180425-ab40-48d0-af93-a447b2743884 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:10:05.351478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 14:10:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:10:05.356959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880454f-29e3-4aa5-b370-8121acaa650b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:10:05.357404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880454f-29e3-4aa5-b370-8121acaa650b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:10:05.357507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880454f-29e3-4aa5-b370-8121acaa650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:10:05.382846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-4880454f-29e3-4aa5-b370-8121acaa650b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:10:05.383978 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4880454f-29e3-4aa5-b370-8121acaa650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:10:05.390928 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 14:10:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:10:05.447081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e88e-2b0a-4795-885c-dc6de2533b49 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:10:05.447373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e88e-2b0a-4795-885c-dc6de2533b49 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:10:05.447656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e88e-2b0a-4795-885c-dc6de2533b49 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:10:05.449299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 750/1500] 10.222.0.36 () {54 vars in 961 bytes} [Wed Oct 27 14:10:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:10:05.454254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc29c-0daa-417c-abe9-0745db2da031 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:10:05.454549 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc29c-0daa-417c-abe9-0745db2da031 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:10:05.454869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc29c-0daa-417c-abe9-0745db2da031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:10:05.476845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7b7dc29c-0daa-417c-abe9-0745db2da031 None None] MFA Rules not processed for user `3c014f6c51ed4c99a1a4450dde18cbef`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:10:05.478010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7b7dc29c-0daa-417c-abe9-0745db2da031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:10:05.483836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 751/1501] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Oct 27 14:10:05 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:10:05.492385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37e88e-2b0a-4795-885c-dc6de2533b49 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:10:05.502845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37e88e-2b0a-4795-885c-dc6de2533b49 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:10:05.506740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453e75c-c0fe-42cc-94bb-c1a616a66c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:10:05.507330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e75c-c0fe-42cc-94bb-c1a616a66c90 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:10:05.507630 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e75c-c0fe-42cc-94bb-c1a616a66c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:10:05.507920 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e75c-c0fe-42cc-94bb-c1a616a66c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:10:05.516648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453e75c-c0fe-42cc-94bb-c1a616a66c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:10:05.541984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453e75c-c0fe-42cc-94bb-c1a616a66c90 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:10:05.551256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 751/1502] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:10:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:47.993496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386dac-c5cf-4857-a91d-b1245a704ffd None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:47.994082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386dac-c5cf-4857-a91d-b1245a704ffd None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:47.994082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386dac-c5cf-4857-a91d-b1245a704ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.029971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-17386dac-c5cf-4857-a91d-b1245a704ffd None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.034582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-17386dac-c5cf-4857-a91d-b1245a704ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.053109 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 752/1503] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:11:48.064005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86976069-2cb5-4fdb-8a52-3734d3725c47 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.064842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86976069-2cb5-4fdb-8a52-3734d3725c47 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.064842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86976069-2cb5-4fdb-8a52-3734d3725c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.114999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-86976069-2cb5-4fdb-8a52-3734d3725c47 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.116163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-86976069-2cb5-4fdb-8a52-3734d3725c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.119274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797f463-77db-451a-b674-a89325afa898 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.119826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797f463-77db-451a-b674-a89325afa898 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.120332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797f463-77db-451a-b674-a89325afa898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.124894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 752/1504] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.129449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86976069-2cb5-4fdb-8a52-3734d3725c47 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.145050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86976069-2cb5-4fdb-8a52-3734d3725c47 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.147964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb113d-5a8c-4472-b7f6-3d1dd8364637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.148861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb113d-5a8c-4472-b7f6-3d1dd8364637 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.149160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb113d-5a8c-4472-b7f6-3d1dd8364637 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.149456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb113d-5a8c-4472-b7f6-3d1dd8364637 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.154648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb113d-5a8c-4472-b7f6-3d1dd8364637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:11:48.154648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb113d-5a8c-4472-b7f6-3d1dd8364637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.171678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-0797f463-77db-451a-b674-a89325afa898 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.173218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0797f463-77db-451a-b674-a89325afa898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.190394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb113d-5a8c-4472-b7f6-3d1dd8364637 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.208511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 753/1505] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.212175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 753/1506] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:11:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:11:48.223485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542e6d5-af71-4f37-bcb5-b7b6e28e7529 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.223804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb113d-5a8c-4472-b7f6-3d1dd8364637 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.224316 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542e6d5-af71-4f37-bcb5-b7b6e28e7529 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.224869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542e6d5-af71-4f37-bcb5-b7b6e28e7529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.237562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb113d-5a8c-4472-b7f6-3d1dd8364637 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.242497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9552f-6643-4fee-b526-d9b65701d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.243438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9552f-6643-4fee-b526-d9b65701d81d admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.243805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9552f-6643-4fee-b526-d9b65701d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.244036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9552f-6643-4fee-b526-d9b65701d81d admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.250276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9552f-6643-4fee-b526-d9b65701d81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.274239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e542e6d5-af71-4f37-bcb5-b7b6e28e7529 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.275427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e542e6d5-af71-4f37-bcb5-b7b6e28e7529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.285248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9552f-6643-4fee-b526-d9b65701d81d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.300722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 754/1507] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.302590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134ce9-13be-4154-b746-7bc48dd5d21f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.304561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134ce9-13be-4154-b746-7bc48dd5d21f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.304860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134ce9-13be-4154-b746-7bc48dd5d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.348648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 754/1508] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:48.349555 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9552f-6643-4fee-b526-d9b65701d81d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.350431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-01134ce9-13be-4154-b746-7bc48dd5d21f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.352176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-01134ce9-13be-4154-b746-7bc48dd5d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.461153 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9552f-6643-4fee-b526-d9b65701d81d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.465279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbb696-fcf6-4961-bf48-8484c4fc4429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.465674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 755/1509] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.465885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbb696-fcf6-4961-bf48-8484c4fc4429 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.466165 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbb696-fcf6-4961-bf48-8484c4fc4429 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.466448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbb696-fcf6-4961-bf48-8484c4fc4429 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.466931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462ffd-28ea-4ba8-b376-e37642922252 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.467169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbb696-fcf6-4961-bf48-8484c4fc4429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:11:48.467274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462ffd-28ea-4ba8-b376-e37642922252 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.467469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbb696-fcf6-4961-bf48-8484c4fc4429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.467669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462ffd-28ea-4ba8-b376-e37642922252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.490225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-68462ffd-28ea-4ba8-b376-e37642922252 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.491513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-68462ffd-28ea-4ba8-b376-e37642922252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.497435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbb696-fcf6-4961-bf48-8484c4fc4429 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.498364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 756/1510] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.499701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4b9c-c60a-4c4c-9183-6c2ca9a54794 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.499979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4b9c-c60a-4c4c-9183-6c2ca9a54794 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.500427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4b9c-c60a-4c4c-9183-6c2ca9a54794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.511185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 755/1511] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:11:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:11:48.511877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbb696-fcf6-4961-bf48-8484c4fc4429 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.528074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-084f4b9c-c60a-4c4c-9183-6c2ca9a54794 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.528308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbb696-fcf6-4961-bf48-8484c4fc4429 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.529226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-084f4b9c-c60a-4c4c-9183-6c2ca9a54794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.532601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b807fc7-baf5-497f-ba4b-bc64329f91ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.533206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b807fc7-baf5-497f-ba4b-bc64329f91ca admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.533497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b807fc7-baf5-497f-ba4b-bc64329f91ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.533778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b807fc7-baf5-497f-ba4b-bc64329f91ca admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.534411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b807fc7-baf5-497f-ba4b-bc64329f91ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.536446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 757/1512] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.537755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae7398-e21e-438e-b1d5-fcf9cf834ab5 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.538052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae7398-e21e-438e-b1d5-fcf9cf834ab5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.538460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae7398-e21e-438e-b1d5-fcf9cf834ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.560326 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-d2ae7398-e21e-438e-b1d5-fcf9cf834ab5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.561216 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b807fc7-baf5-497f-ba4b-bc64329f91ca admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.561456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d2ae7398-e21e-438e-b1d5-fcf9cf834ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.568344 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 758/1513] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.570240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79891fa-32cd-44b4-b6e4-17ece6d44970 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.570586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79891fa-32cd-44b4-b6e4-17ece6d44970 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.570871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79891fa-32cd-44b4-b6e4-17ece6d44970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.584758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 756/1514] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/users => generated 293 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:48.587415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281b5e-eab8-406f-a08f-3a77b01dd8a9 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.587731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281b5e-eab8-406f-a08f-3a77b01dd8a9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.588005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281b5e-eab8-406f-a08f-3a77b01dd8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.594505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b79891fa-32cd-44b4-b6e4-17ece6d44970 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.595669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b79891fa-32cd-44b4-b6e4-17ece6d44970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.602828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 759/1515] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.607660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeac717-3028-4b1a-ae6d-48658c12e775 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.608092 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeac717-3028-4b1a-ae6d-48658c12e775 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.608280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeac717-3028-4b1a-ae6d-48658c12e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.610909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-dc281b5e-eab8-406f-a08f-3a77b01dd8a9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.612057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-dc281b5e-eab8-406f-a08f-3a77b01dd8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.623938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 757/1516] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.625178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e620b-ee48-421f-a8b1-e4529351b31e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.625477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e620b-ee48-421f-a8b1-e4529351b31e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.625769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e620b-ee48-421f-a8b1-e4529351b31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.635406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-abeac717-3028-4b1a-ae6d-48658c12e775 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.636600 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-abeac717-3028-4b1a-ae6d-48658c12e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.644408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 760/1517] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.644957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeac717-3028-4b1a-ae6d-48658c12e775 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.653787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeac717-3028-4b1a-ae6d-48658c12e775 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.656949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7d7e620b-ee48-421f-a8b1-e4529351b31e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.657841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbaaa-fb6e-4033-81ad-897d95daddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.658124 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7d7e620b-ee48-421f-a8b1-e4529351b31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.658419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbaaa-fb6e-4033-81ad-897d95daddad admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.658737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbaaa-fb6e-4033-81ad-897d95daddad admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.659040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cbaaa-fb6e-4033-81ad-897d95daddad admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.659667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cbaaa-fb6e-4033-81ad-897d95daddad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.665236 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 758/1518] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.666561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330bbbc-7b5f-407a-a8ec-d369c70c705d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.666966 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330bbbc-7b5f-407a-a8ec-d369c70c705d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.667255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330bbbc-7b5f-407a-a8ec-d369c70c705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.686053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cbaaa-fb6e-4033-81ad-897d95daddad admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.692117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1330bbbc-7b5f-407a-a8ec-d369c70c705d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.693263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1330bbbc-7b5f-407a-a8ec-d369c70c705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.701260 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 759/1519] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.702649 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facc5b0-bd7f-454f-8eb1-7a4a3d695ac8 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.702649 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facc5b0-bd7f-454f-8eb1-7a4a3d695ac8 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.702849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facc5b0-bd7f-454f-8eb1-7a4a3d695ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.713856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 761/1520] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/projects => generated 391 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:48.714698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbaaa-fb6e-4033-81ad-897d95daddad admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.726847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6facc5b0-bd7f-454f-8eb1-7a4a3d695ac8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.728022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6facc5b0-bd7f-454f-8eb1-7a4a3d695ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.784351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cbaaa-fb6e-4033-81ad-897d95daddad admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.788813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeeba9-810c-41fe-8957-2a5a885280db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.789568 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeeba9-810c-41fe-8957-2a5a885280db admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.789866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeeba9-810c-41fe-8957-2a5a885280db admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.790147 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeeba9-810c-41fe-8957-2a5a885280db admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.790880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeeba9-810c-41fe-8957-2a5a885280db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.795919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 760/1521] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.800110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d457-e4d9-45fc-99ec-5b9e3efb02ea None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.800110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d457-e4d9-45fc-99ec-5b9e3efb02ea None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.800110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d457-e4d9-45fc-99ec-5b9e3efb02ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.817019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeeba9-810c-41fe-8957-2a5a885280db admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.820895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-4c39d457-e4d9-45fc-99ec-5b9e3efb02ea None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.822370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4c39d457-e4d9-45fc-99ec-5b9e3efb02ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.828393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 762/1522] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:48 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:48.829401 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 761/1523] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.829675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2405c71-7940-4fb4-b7d1-dc69445c6e9e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.829971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2405c71-7940-4fb4-b7d1-dc69445c6e9e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.830083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d457-e4d9-45fc-99ec-5b9e3efb02ea None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.830302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2405c71-7940-4fb4-b7d1-dc69445c6e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.839263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d457-e4d9-45fc-99ec-5b9e3efb02ea None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.843351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb5002-3856-4a02-9a65-47c31ea673d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.843944 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb5002-3856-4a02-9a65-47c31ea673d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.844229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb5002-3856-4a02-9a65-47c31ea673d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.844517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb5002-3856-4a02-9a65-47c31ea673d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.845203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb5002-3856-4a02-9a65-47c31ea673d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:11:48.845502 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb5002-3856-4a02-9a65-47c31ea673d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.856825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b2405c71-7940-4fb4-b7d1-dc69445c6e9e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:48.857992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b2405c71-7940-4fb4-b7d1-dc69445c6e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:48.869168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 763/1524] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:48.870013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2405c71-7940-4fb4-b7d1-dc69445c6e9e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.873227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb5002-3856-4a02-9a65-47c31ea673d9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.879441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2405c71-7940-4fb4-b7d1-dc69445c6e9e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.884261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e9814-255b-445e-b825-7b301f0517ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.884843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e9814-255b-445e-b825-7b301f0517ca admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.885132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e9814-255b-445e-b825-7b301f0517ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.885412 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e9814-255b-445e-b825-7b301f0517ca admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.886089 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e9814-255b-445e-b825-7b301f0517ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:11:48.886384 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e9814-255b-445e-b825-7b301f0517ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.887972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 762/1525] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:11:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:11:48.888786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb5002-3856-4a02-9a65-47c31ea673d9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.897991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb5002-3856-4a02-9a65-47c31ea673d9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.902109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa579f-5a89-4968-b92f-a8334f01d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.902715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa579f-5a89-4968-b92f-a8334f01d9bf admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.903010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa579f-5a89-4968-b92f-a8334f01d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.903300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa579f-5a89-4968-b92f-a8334f01d9bf admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.903967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa579f-5a89-4968-b92f-a8334f01d9bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:11:48.904268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa579f-5a89-4968-b92f-a8334f01d9bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.912697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e9814-255b-445e-b825-7b301f0517ca admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.926331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 764/1526] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:11:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:11:48.927841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e9814-255b-445e-b825-7b301f0517ca admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.929839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa579f-5a89-4968-b92f-a8334f01d9bf admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.938000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e9814-255b-445e-b825-7b301f0517ca admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.942036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd09c6-a1e2-4e73-a026-91ca7ca9bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.942642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd09c6-a1e2-4e73-a026-91ca7ca9bd7d admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.942943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd09c6-a1e2-4e73-a026-91ca7ca9bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.943071 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 763/1527] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:11:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:11:48.943821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa579f-5a89-4968-b92f-a8334f01d9bf admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:48.946933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd09c6-a1e2-4e73-a026-91ca7ca9bd7d admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.947619 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd09c6-a1e2-4e73-a026-91ca7ca9bd7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.953581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa579f-5a89-4968-b92f-a8334f01d9bf admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:48.957753 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db32f3a-9a28-4f3c-8564-4f271cf04aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:48.958329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db32f3a-9a28-4f3c-8564-4f271cf04aeb admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:48.958651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db32f3a-9a28-4f3c-8564-4f271cf04aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:48.958949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db32f3a-9a28-4f3c-8564-4f271cf04aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:48.959621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db32f3a-9a28-4f3c-8564-4f271cf04aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:11:48.959921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db32f3a-9a28-4f3c-8564-4f271cf04aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:48.974198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd09c6-a1e2-4e73-a026-91ca7ca9bd7d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.986739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db32f3a-9a28-4f3c-8564-4f271cf04aeb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:48.999638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 765/1528] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:48 2021] POST /identity/v3/users => generated 296 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:48.999638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd09c6-a1e2-4e73-a026-91ca7ca9bd7d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.004811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 764/1529] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:11:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:11:49.008162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd09c6-a1e2-4e73-a026-91ca7ca9bd7d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.012515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004f440-6f25-4f42-9777-99cfd541e582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.012685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db32f3a-9a28-4f3c-8564-4f271cf04aeb admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.013479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004f440-6f25-4f42-9777-99cfd541e582 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.013778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004f440-6f25-4f42-9777-99cfd541e582 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.014066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004f440-6f25-4f42-9777-99cfd541e582 admin admin] PATH_INFO: `/v3/projects/32e064bd64034775bfe5271d56d189d9/users/d33fa612914a45dca090798991b8dfb0/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.022295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db32f3a-9a28-4f3c-8564-4f271cf04aeb admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.028168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112d29a-8200-4262-ab6a-6a5b15f2b8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.029147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112d29a-8200-4262-ab6a-6a5b15f2b8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.029147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112d29a-8200-4262-ab6a-6a5b15f2b8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.029340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112d29a-8200-4262-ab6a-6a5b15f2b8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.029976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112d29a-8200-4262-ab6a-6a5b15f2b8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:11:49.030271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112d29a-8200-4262-ab6a-6a5b15f2b8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.035998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004f440-6f25-4f42-9777-99cfd541e582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e064bd64034775bfe5271d56d189d9, user_id=d33fa612914a45dca090798991b8dfb0, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.056127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112d29a-8200-4262-ab6a-6a5b15f2b8f8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.063788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004f440-6f25-4f42-9777-99cfd541e582 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.070462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 765/1530] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:11:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:11:49.071304 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112d29a-8200-4262-ab6a-6a5b15f2b8f8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.079649 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 766/1531] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:48 2021] PUT /identity/v3/projects/32e064bd64034775bfe5271d56d189d9/users/d33fa612914a45dca090798991b8dfb0/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:49.083168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004f440-6f25-4f42-9777-99cfd541e582 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.083317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112d29a-8200-4262-ab6a-6a5b15f2b8f8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.145791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62cb04-8aff-4ff9-af97-685ae643b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.146394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62cb04-8aff-4ff9-af97-685ae643b804 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.146709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62cb04-8aff-4ff9-af97-685ae643b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.146992 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62cb04-8aff-4ff9-af97-685ae643b804 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.148687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62cb04-8aff-4ff9-af97-685ae643b804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:11:49.148992 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62cb04-8aff-4ff9-af97-685ae643b804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.150908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004f440-6f25-4f42-9777-99cfd541e582 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.155266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982e272-7d54-4169-950c-49e57c39afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.155861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982e272-7d54-4169-950c-49e57c39afd1 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.156182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982e272-7d54-4169-950c-49e57c39afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.156438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982e272-7d54-4169-950c-49e57c39afd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.157070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982e272-7d54-4169-950c-49e57c39afd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.174527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62cb04-8aff-4ff9-af97-685ae643b804 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.183260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982e272-7d54-4169-950c-49e57c39afd1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.187280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 766/1532] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:11:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:11:49.187920 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62cb04-8aff-4ff9-af97-685ae643b804 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.205156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62cb04-8aff-4ff9-af97-685ae643b804 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.212859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c953f-f8fb-4a97-b963-c69e6872070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.213467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c953f-f8fb-4a97-b963-c69e6872070d admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.213727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c953f-f8fb-4a97-b963-c69e6872070d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.214016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c953f-f8fb-4a97-b963-c69e6872070d admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.214897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 767/1533] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.215091 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c953f-f8fb-4a97-b963-c69e6872070d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.219190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982e272-7d54-4169-950c-49e57c39afd1 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.240749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c953f-f8fb-4a97-b963-c69e6872070d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.269137 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 767/1534] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.270040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c953f-f8fb-4a97-b963-c69e6872070d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.291968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982e272-7d54-4169-950c-49e57c39afd1 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.342276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c953f-f8fb-4a97-b963-c69e6872070d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.346719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f9ca0-f48f-4a48-8823-098d1a28f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.347417 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f9ca0-f48f-4a48-8823-098d1a28f8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.347859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f9ca0-f48f-4a48-8823-098d1a28f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.348148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f9ca0-f48f-4a48-8823-098d1a28f8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.348860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f9ca0-f48f-4a48-8823-098d1a28f8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.356047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa50e0-501d-4005-9116-c239e0fdf1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.356640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa50e0-501d-4005-9116-c239e0fdf1be admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.356928 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa50e0-501d-4005-9116-c239e0fdf1be admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.357207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa50e0-501d-4005-9116-c239e0fdf1be admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.357832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa50e0-501d-4005-9116-c239e0fdf1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.374959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f9ca0-f48f-4a48-8823-098d1a28f8b0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.384571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa50e0-501d-4005-9116-c239e0fdf1be admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.386356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 768/1535] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:49 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:49.387851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f9ca0-f48f-4a48-8823-098d1a28f8b0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.397714 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f9ca0-f48f-4a48-8823-098d1a28f8b0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.402385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9c785-8f2e-4795-b05f-bbf7daf99489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.403059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c785-8f2e-4795-b05f-bbf7daf99489 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.403357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c785-8f2e-4795-b05f-bbf7daf99489 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.403736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9c785-8f2e-4795-b05f-bbf7daf99489 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.404299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9c785-8f2e-4795-b05f-bbf7daf99489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.411128 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 768/1536] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.411903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa50e0-501d-4005-9116-c239e0fdf1be admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.439410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9c785-8f2e-4795-b05f-bbf7daf99489 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.470664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 769/1537] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.470664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794ee3f-7232-4f7a-bc28-ecf29fcb3bf5 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.470664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794ee3f-7232-4f7a-bc28-ecf29fcb3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.470664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794ee3f-7232-4f7a-bc28-ecf29fcb3bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.484030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa50e0-501d-4005-9116-c239e0fdf1be admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.492115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8794ee3f-7232-4f7a-bc28-ecf29fcb3bf5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:49.493268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8794ee3f-7232-4f7a-bc28-ecf29fcb3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:49.547190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bca1b-fb04-4fa1-a8f0-19e651787eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.547709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bca1b-fb04-4fa1-a8f0-19e651787eaa admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.548001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bca1b-fb04-4fa1-a8f0-19e651787eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.548287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bca1b-fb04-4fa1-a8f0-19e651787eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.548922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bca1b-fb04-4fa1-a8f0-19e651787eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.559872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 770/1538] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:49.560695 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794ee3f-7232-4f7a-bc28-ecf29fcb3bf5 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.570245 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794ee3f-7232-4f7a-bc28-ecf29fcb3bf5 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.574522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ab140-c397-4951-a4d7-2409135b8982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.575147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ab140-c397-4951-a4d7-2409135b8982 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.575442 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ab140-c397-4951-a4d7-2409135b8982 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.575729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ab140-c397-4951-a4d7-2409135b8982 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.576366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ab140-c397-4951-a4d7-2409135b8982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.579843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bca1b-fb04-4fa1-a8f0-19e651787eaa admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.603392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ab140-c397-4951-a4d7-2409135b8982 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.606374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 769/1539] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/projects => generated 405 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.610472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bca1b-fb04-4fa1-a8f0-19e651787eaa admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.632659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 771/1540] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.633740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ab140-c397-4951-a4d7-2409135b8982 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.680149 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bca1b-fb04-4fa1-a8f0-19e651787eaa admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.702801 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ab140-c397-4951-a4d7-2409135b8982 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.707087 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c7a21-38d1-4cbe-aaf0-1057b6760d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.707699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c7a21-38d1-4cbe-aaf0-1057b6760d1a admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.707991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c7a21-38d1-4cbe-aaf0-1057b6760d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.708278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c7a21-38d1-4cbe-aaf0-1057b6760d1a admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.708917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c7a21-38d1-4cbe-aaf0-1057b6760d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.740179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c7a21-38d1-4cbe-aaf0-1057b6760d1a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.754714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0f261-3b50-49a5-89bd-f24c4839cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.755357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0f261-3b50-49a5-89bd-f24c4839cc46 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.755643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0f261-3b50-49a5-89bd-f24c4839cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.755926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0f261-3b50-49a5-89bd-f24c4839cc46 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.756556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0f261-3b50-49a5-89bd-f24c4839cc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.760448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 772/1541] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.761308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c7a21-38d1-4cbe-aaf0-1057b6760d1a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.770424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c7a21-38d1-4cbe-aaf0-1057b6760d1a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.774657 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019b2a-d107-42fd-af26-4b51e17ed396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.775540 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019b2a-d107-42fd-af26-4b51e17ed396 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.775834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019b2a-d107-42fd-af26-4b51e17ed396 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.776119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019b2a-d107-42fd-af26-4b51e17ed396 admin admin] PATH_INFO: `/v3/projects/161bb4893aa14d7b83cfc4b20cb9846a/users/d2795429673642c5bd5547bf29281946/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.784159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0f261-3b50-49a5-89bd-f24c4839cc46 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.797685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0019b2a-d107-42fd-af26-4b51e17ed396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161bb4893aa14d7b83cfc4b20cb9846a, user_id=d2795429673642c5bd5547bf29281946, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.805975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 770/1542] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.806518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0f261-3b50-49a5-89bd-f24c4839cc46 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.816179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0f261-3b50-49a5-89bd-f24c4839cc46 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.820763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99c377-765a-42f9-8140-0d4e929bbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.821380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c377-765a-42f9-8140-0d4e929bbcfe admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.821668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c377-765a-42f9-8140-0d4e929bbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.821947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c377-765a-42f9-8140-0d4e929bbcfe admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.822574 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99c377-765a-42f9-8140-0d4e929bbcfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.825452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0019b2a-d107-42fd-af26-4b51e17ed396 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.840187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 773/1543] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:49 2021] PUT /identity/v3/projects/161bb4893aa14d7b83cfc4b20cb9846a/users/d2795429673642c5bd5547bf29281946/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:49.849937 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019b2a-d107-42fd-af26-4b51e17ed396 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.850062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99c377-765a-42f9-8140-0d4e929bbcfe admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.871102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 771/1544] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/users => generated 290 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.871943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99c377-765a-42f9-8140-0d4e929bbcfe admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.873460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5d99c377-765a-42f9-8140-0d4e929bbcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:49.918359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019b2a-d107-42fd-af26-4b51e17ed396 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.923754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261f118-92c2-4dc4-a0e3-c7b6324ee602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.924446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261f118-92c2-4dc4-a0e3-c7b6324ee602 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.924746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261f118-92c2-4dc4-a0e3-c7b6324ee602 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.925043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261f118-92c2-4dc4-a0e3-c7b6324ee602 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:49.926042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261f118-92c2-4dc4-a0e3-c7b6324ee602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:49.938976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99c377-765a-42f9-8140-0d4e929bbcfe admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.952842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261f118-92c2-4dc4-a0e3-c7b6324ee602 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:49.976445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 774/1545] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:49.980489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261f118-92c2-4dc4-a0e3-c7b6324ee602 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:49.990871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261f118-92c2-4dc4-a0e3-c7b6324ee602 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:49.996654 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316584ba-a536-489b-8a02-dbf90d47778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:49.997736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316584ba-a536-489b-8a02-dbf90d47778f admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:49.998451 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316584ba-a536-489b-8a02-dbf90d47778f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:49.998926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316584ba-a536-489b-8a02-dbf90d47778f admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.000077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316584ba-a536-489b-8a02-dbf90d47778f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.001197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f2e01-49fe-461d-ac78-670b75a49812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.001896 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f2e01-49fe-461d-ac78-670b75a49812 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.002205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f2e01-49fe-461d-ac78-670b75a49812 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.002477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f2e01-49fe-461d-ac78-670b75a49812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.011779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f2e01-49fe-461d-ac78-670b75a49812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.029632 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316584ba-a536-489b-8a02-dbf90d47778f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.036789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f2e01-49fe-461d-ac78-670b75a49812 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.048168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 772/1546] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:50.048975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f2e01-49fe-461d-ac78-670b75a49812 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.056944 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 775/1547] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:49 2021] POST /identity/v3/users => generated 303 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:50.056944 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316584ba-a536-489b-8a02-dbf90d47778f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.059366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f2e01-49fe-461d-ac78-670b75a49812 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.064314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda188-07fb-4f17-8512-49ab5145c42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.065344 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda188-07fb-4f17-8512-49ab5145c42b admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.065832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda188-07fb-4f17-8512-49ab5145c42b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.066076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda188-07fb-4f17-8512-49ab5145c42b admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.066859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda188-07fb-4f17-8512-49ab5145c42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.068686 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316584ba-a536-489b-8a02-dbf90d47778f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.073551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7480-7f10-4296-be79-6416ab73a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.074222 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7480-7f10-4296-be79-6416ab73a20f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.074518 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7480-7f10-4296-be79-6416ab73a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.075240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7480-7f10-4296-be79-6416ab73a20f admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.075971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c7480-7f10-4296-be79-6416ab73a20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.096817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda188-07fb-4f17-8512-49ab5145c42b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.110581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c7480-7f10-4296-be79-6416ab73a20f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.121439 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 773/1548] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:50 2021] POST /identity/v3/users => generated 291 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:50.122266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda188-07fb-4f17-8512-49ab5145c42b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.123818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 776/1549] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:50.124929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c57035-7bd4-4d7c-847d-a64b04a438e8 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.125234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c57035-7bd4-4d7c-847d-a64b04a438e8 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.125829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c57035-7bd4-4d7c-847d-a64b04a438e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.134885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda188-07fb-4f17-8512-49ab5145c42b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.139837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187c2e2-442b-49c1-8c2c-954329085a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.140429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187c2e2-442b-49c1-8c2c-954329085a9a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.140716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187c2e2-442b-49c1-8c2c-954329085a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.140997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187c2e2-442b-49c1-8c2c-954329085a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.141689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187c2e2-442b-49c1-8c2c-954329085a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.168273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187c2e2-442b-49c1-8c2c-954329085a9a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.174526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-96c57035-7bd4-4d7c-847d-a64b04a438e8 None None] MFA Rules not processed for user `d2795429673642c5bd5547bf29281946`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:50.175871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-96c57035-7bd4-4d7c-847d-a64b04a438e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:50.182991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 774/1550] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:50.182991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187c2e2-442b-49c1-8c2c-954329085a9a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.190806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187c2e2-442b-49c1-8c2c-954329085a9a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.195897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1626ea5-1f39-4a22-8c73-df1544518724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.196626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1626ea5-1f39-4a22-8c73-df1544518724 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.197060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1626ea5-1f39-4a22-8c73-df1544518724 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.197353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1626ea5-1f39-4a22-8c73-df1544518724 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.198135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1626ea5-1f39-4a22-8c73-df1544518724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.224630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1626ea5-1f39-4a22-8c73-df1544518724 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.237845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 775/1551] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:50.237845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1626ea5-1f39-4a22-8c73-df1544518724 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.250749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1626ea5-1f39-4a22-8c73-df1544518724 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.255785 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ed4fd-b558-45ad-8ad0-fb66c7f679eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.256559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ed4fd-b558-45ad-8ad0-fb66c7f679eb admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.257108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ed4fd-b558-45ad-8ad0-fb66c7f679eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.257474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ed4fd-b558-45ad-8ad0-fb66c7f679eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.258466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ed4fd-b558-45ad-8ad0-fb66c7f679eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.268238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 777/1552] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:50 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:50.268238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c57035-7bd4-4d7c-847d-a64b04a438e8 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.277914 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c57035-7bd4-4d7c-847d-a64b04a438e8 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.282394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84c17-be46-4785-8295-d13f23012b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.282995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84c17-be46-4785-8295-d13f23012b4f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.283331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84c17-be46-4785-8295-d13f23012b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.283624 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84c17-be46-4785-8295-d13f23012b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.284292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def84c17-be46-4785-8295-d13f23012b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.285287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ed4fd-b558-45ad-8ad0-fb66c7f679eb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.300218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 776/1553] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:50.301342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ed4fd-b558-45ad-8ad0-fb66c7f679eb admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.315225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def84c17-be46-4785-8295-d13f23012b4f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.316689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ed4fd-b558-45ad-8ad0-fb66c7f679eb admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.323433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1dbb5-16e3-43d2-8239-b6a468944506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.324342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1dbb5-16e3-43d2-8239-b6a468944506 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.324815 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1dbb5-16e3-43d2-8239-b6a468944506 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.325296 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1dbb5-16e3-43d2-8239-b6a468944506 admin admin] PATH_INFO: `/v3/projects/ee25e97ab6e24a11a24419e6efb65aba/users/68dec737af2c4fba8737f17e6cf45259/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.329768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 778/1554] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:50.329768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84c17-be46-4785-8295-d13f23012b4f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.340675 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84c17-be46-4785-8295-d13f23012b4f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.345191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911aee2-0add-4844-970d-b2fff49b37c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.345878 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911aee2-0add-4844-970d-b2fff49b37c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.346171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911aee2-0add-4844-970d-b2fff49b37c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.346460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911aee2-0add-4844-970d-b2fff49b37c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.347217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911aee2-0add-4844-970d-b2fff49b37c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.348541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1dbb5-16e3-43d2-8239-b6a468944506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee25e97ab6e24a11a24419e6efb65aba, user_id=68dec737af2c4fba8737f17e6cf45259, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.374171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911aee2-0add-4844-970d-b2fff49b37c5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.376767 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1dbb5-16e3-43d2-8239-b6a468944506 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.387005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 779/1555] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:50.387891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911aee2-0add-4844-970d-b2fff49b37c5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.391428 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 777/1556] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:50 2021] PUT /identity/v3/projects/ee25e97ab6e24a11a24419e6efb65aba/users/68dec737af2c4fba8737f17e6cf45259/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:50.392363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1dbb5-16e3-43d2-8239-b6a468944506 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.397091 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911aee2-0add-4844-970d-b2fff49b37c5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.469129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1dbb5-16e3-43d2-8239-b6a468944506 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.471864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182ae8-99aa-4cd6-ae8e-5c0ff9ac404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.473048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182ae8-99aa-4cd6-ae8e-5c0ff9ac404a admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.473579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182ae8-99aa-4cd6-ae8e-5c0ff9ac404a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.473794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bb044-3851-48d8-9e96-835ca23e1cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.474332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182ae8-99aa-4cd6-ae8e-5c0ff9ac404a admin admin] PATH_INFO: `/v3/projects/6a767bf41441494bbce465f04936246c/users/b3f48a9915a14ab6acee1f8a1e36968f/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.474740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bb044-3851-48d8-9e96-835ca23e1cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.475034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bb044-3851-48d8-9e96-835ca23e1cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.475321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bb044-3851-48d8-9e96-835ca23e1cf0 admin admin] PATH_INFO: `/v3/projects/b3b35552e84f4a30bab9b2f278d5dfdb/users/231001befca04f798ca7e580825b19b2/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.499835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9182ae8-99aa-4cd6-ae8e-5c0ff9ac404a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a767bf41441494bbce465f04936246c, user_id=b3f48a9915a14ab6acee1f8a1e36968f, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.508194 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bb044-3851-48d8-9e96-835ca23e1cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b35552e84f4a30bab9b2f278d5dfdb, user_id=231001befca04f798ca7e580825b19b2, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.528715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9182ae8-99aa-4cd6-ae8e-5c0ff9ac404a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.537653 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bb044-3851-48d8-9e96-835ca23e1cf0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.544462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 780/1557] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:50 2021] PUT /identity/v3/projects/6a767bf41441494bbce465f04936246c/users/b3f48a9915a14ab6acee1f8a1e36968f/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:50.545414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182ae8-99aa-4cd6-ae8e-5c0ff9ac404a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.554957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 778/1558] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:50 2021] PUT /identity/v3/projects/b3b35552e84f4a30bab9b2f278d5dfdb/users/231001befca04f798ca7e580825b19b2/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:50.556206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bb044-3851-48d8-9e96-835ca23e1cf0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.633271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182ae8-99aa-4cd6-ae8e-5c0ff9ac404a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.639401 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b6227-ed37-4995-95f2-43eb58302d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.640559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b6227-ed37-4995-95f2-43eb58302d0d admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.640858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b6227-ed37-4995-95f2-43eb58302d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.641066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bb044-3851-48d8-9e96-835ca23e1cf0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.641298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b6227-ed37-4995-95f2-43eb58302d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.642524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b6227-ed37-4995-95f2-43eb58302d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.646301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c175e5a-ce55-4888-9751-44b6e56d281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.647279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175e5a-ce55-4888-9751-44b6e56d281c admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.648208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175e5a-ce55-4888-9751-44b6e56d281c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.648598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175e5a-ce55-4888-9751-44b6e56d281c admin admin] PATH_INFO: `/v3/projects/a32d3bb833eb4a8ea5bb9428523f7587/users/45b340bfc21940979721e201c67e12a6/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.668860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c175e5a-ce55-4888-9751-44b6e56d281c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32d3bb833eb4a8ea5bb9428523f7587, user_id=45b340bfc21940979721e201c67e12a6, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.672873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b6227-ed37-4995-95f2-43eb58302d0d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.696650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c175e5a-ce55-4888-9751-44b6e56d281c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.710773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 781/1559] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:50 2021] POST /identity/v3/projects => generated 393 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:50.710773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b6227-ed37-4995-95f2-43eb58302d0d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.711327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 779/1560] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:50 2021] PUT /identity/v3/projects/a32d3bb833eb4a8ea5bb9428523f7587/users/45b340bfc21940979721e201c67e12a6/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:50.712287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c175e5a-ce55-4888-9751-44b6e56d281c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:50.782590 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b6227-ed37-4995-95f2-43eb58302d0d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.787627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53453b24-fce6-46e2-bda1-89727c4ce647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.788998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53453b24-fce6-46e2-bda1-89727c4ce647 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.789288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53453b24-fce6-46e2-bda1-89727c4ce647 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.789565 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53453b24-fce6-46e2-bda1-89727c4ce647 admin admin] PATH_INFO: `/v3/projects/71891beeb9cf4a9a95067ff34e318014/users/2083abdeeae44796af8b84b757a3855e/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.797033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c175e5a-ce55-4888-9751-44b6e56d281c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:50.801642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fea1b-af1a-435f-839f-ea69134168bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:50.802493 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fea1b-af1a-435f-839f-ea69134168bb admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.802820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fea1b-af1a-435f-839f-ea69134168bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.812634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fea1b-af1a-435f-839f-ea69134168bb admin admin] PATH_INFO: `/v3/projects/fd8e81f8654c461da6c9a3a41e80c7ba/users/b86f472c880143bda1e31ef5f010e736/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.814747 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53453b24-fce6-46e2-bda1-89727c4ce647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71891beeb9cf4a9a95067ff34e318014, user_id=2083abdeeae44796af8b84b757a3855e, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.837314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fea1b-af1a-435f-839f-ea69134168bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8e81f8654c461da6c9a3a41e80c7ba, user_id=b86f472c880143bda1e31ef5f010e736, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:50.842776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53453b24-fce6-46e2-bda1-89727c4ce647 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.858689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 782/1561] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:50 2021] PUT /identity/v3/projects/71891beeb9cf4a9a95067ff34e318014/users/2083abdeeae44796af8b84b757a3855e/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:50.863629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f962-a152-4772-bc24-55854124871b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.864065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f962-a152-4772-bc24-55854124871b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.864434 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f962-a152-4772-bc24-55854124871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.865502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fea1b-af1a-435f-839f-ea69134168bb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:50.879762 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 780/1562] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:50 2021] PUT /identity/v3/projects/fd8e81f8654c461da6c9a3a41e80c7ba/users/b86f472c880143bda1e31ef5f010e736/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:50.881465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d45874-5d58-4ce4-9ab1-f6c6bfa005ff None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:50.881811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d45874-5d58-4ce4-9ab1-f6c6bfa005ff None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:50.882247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d45874-5d58-4ce4-9ab1-f6c6bfa005ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:50.912999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-a749f962-a152-4772-bc24-55854124871b None None] MFA Rules not processed for user `68dec737af2c4fba8737f17e6cf45259`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:50.914963 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a749f962-a152-4772-bc24-55854124871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:50.930683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-23d45874-5d58-4ce4-9ab1-f6c6bfa005ff None None] MFA Rules not processed for user `b3f48a9915a14ab6acee1f8a1e36968f`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:50.931889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-23d45874-5d58-4ce4-9ab1-f6c6bfa005ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:51.015752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 783/1563] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:50 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.017523 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5a408-50e1-424d-bc0a-d88f56f3b7de None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.017643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 781/1564] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:50 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.018404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d45874-5d58-4ce4-9ab1-f6c6bfa005ff None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:51.018797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5a408-50e1-424d-bc0a-d88f56f3b7de None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.019239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5a408-50e1-424d-bc0a-d88f56f3b7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.057364 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-05f5a408-50e1-424d-bc0a-d88f56f3b7de None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:51.058684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-05f5a408-50e1-424d-bc0a-d88f56f3b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:51.106186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d45874-5d58-4ce4-9ab1-f6c6bfa005ff None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:51.110535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d136a1-9160-4124-885e-3cf76a7184e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:51.111185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d136a1-9160-4124-885e-3cf76a7184e2 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.111484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d136a1-9160-4124-885e-3cf76a7184e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.111773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d136a1-9160-4124-885e-3cf76a7184e2 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.112799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d136a1-9160-4124-885e-3cf76a7184e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:51.138943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d136a1-9160-4124-885e-3cf76a7184e2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:51.166931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 782/1565] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:51.168376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77bd8a-9ff9-4b0b-8803-5415c59145c2 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.168770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77bd8a-9ff9-4b0b-8803-5415c59145c2 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.169149 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77bd8a-9ff9-4b0b-8803-5415c59145c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.186890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 784/1566] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.189049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97eb2-b714-4a76-95c2-88927310a2dc None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.189556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97eb2-b714-4a76-95c2-88927310a2dc None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.190053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97eb2-b714-4a76-95c2-88927310a2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.197459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-9a77bd8a-9ff9-4b0b-8803-5415c59145c2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:51.198896 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9a77bd8a-9ff9-4b0b-8803-5415c59145c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:51.206190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 783/1567] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.210460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556e87c-62fd-4177-ae4c-fa4623679681 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.210460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556e87c-62fd-4177-ae4c-fa4623679681 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.210460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556e87c-62fd-4177-ae4c-fa4623679681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.221786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-d4d97eb2-b714-4a76-95c2-88927310a2dc None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:51.222979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d4d97eb2-b714-4a76-95c2-88927310a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:51.231978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 785/1568] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.236305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064435e-1365-406d-bfd1-2a4109cbd5a7 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.236612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064435e-1365-406d-bfd1-2a4109cbd5a7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.236906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064435e-1365-406d-bfd1-2a4109cbd5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.251169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-1556e87c-62fd-4177-ae4c-fa4623679681 None None] MFA Rules not processed for user `b86f472c880143bda1e31ef5f010e736`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:51.252467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1556e87c-62fd-4177-ae4c-fa4623679681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:51.277023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7064435e-1365-406d-bfd1-2a4109cbd5a7 None None] MFA Rules not processed for user `d33fa612914a45dca090798991b8dfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:51.278274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7064435e-1365-406d-bfd1-2a4109cbd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:51.333322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 784/1569] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.333945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556e87c-62fd-4177-ae4c-fa4623679681 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:51.345317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556e87c-62fd-4177-ae4c-fa4623679681 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:51.350146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda762fc-cb20-4f27-bed0-c6f2e8ab203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:51.350942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda762fc-cb20-4f27-bed0-c6f2e8ab203b admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.351734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda762fc-cb20-4f27-bed0-c6f2e8ab203b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.352027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda762fc-cb20-4f27-bed0-c6f2e8ab203b admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.352693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda762fc-cb20-4f27-bed0-c6f2e8ab203b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:51.368335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 786/1570] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.372107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfbc7b-f6ab-4246-b42a-c3a66ca7ee9a None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.375046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfbc7b-f6ab-4246-b42a-c3a66ca7ee9a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.375046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfbc7b-f6ab-4246-b42a-c3a66ca7ee9a None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.376814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 787/1571] 10.222.0.36 () {54 vars in 954 bytes} [Wed Oct 27 14:11:51 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:11:51.380466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfbc7b-f6ab-4246-b42a-c3a66ca7ee9a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:51.384814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda762fc-cb20-4f27-bed0-c6f2e8ab203b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:51.395486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfbc7b-f6ab-4246-b42a-c3a66ca7ee9a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:51.401664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6948690-be72-4873-96cc-a0a77f190d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:51.402436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6948690-be72-4873-96cc-a0a77f190d34 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.403427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6948690-be72-4873-96cc-a0a77f190d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.403427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6948690-be72-4873-96cc-a0a77f190d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.404335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6948690-be72-4873-96cc-a0a77f190d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:51.415944 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 785/1572] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:51.419916 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda762fc-cb20-4f27-bed0-c6f2e8ab203b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:51.431937 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6948690-be72-4873-96cc-a0a77f190d34 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:51.443178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 788/1573] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:51 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:51.444156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6948690-be72-4873-96cc-a0a77f190d34 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:51.489116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda762fc-cb20-4f27-bed0-c6f2e8ab203b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:51.493378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2105-88f7-4e6d-9eda-5f5d49390e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:51.493988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2105-88f7-4e6d-9eda-5f5d49390e42 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.494283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2105-88f7-4e6d-9eda-5f5d49390e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.494571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2105-88f7-4e6d-9eda-5f5d49390e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.571216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c2105-88f7-4e6d-9eda-5f5d49390e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:51.592904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6948690-be72-4873-96cc-a0a77f190d34 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:51.596343 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6df6eb-65fa-4bab-918e-62c8f1dd1f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:51.596691 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c2105-88f7-4e6d-9eda-5f5d49390e42 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:51.596919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6df6eb-65fa-4bab-918e-62c8f1dd1f99 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.597210 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6df6eb-65fa-4bab-918e-62c8f1dd1f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.597497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6df6eb-65fa-4bab-918e-62c8f1dd1f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.607009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 786/1574] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:51.607861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2105-88f7-4e6d-9eda-5f5d49390e42 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:51.608096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6df6eb-65fa-4bab-918e-62c8f1dd1f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:51.617178 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2105-88f7-4e6d-9eda-5f5d49390e42 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:51.620907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0676d48-cc38-4136-9928-c84f12ef4a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:51.621493 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0676d48-cc38-4136-9928-c84f12ef4a1e service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.621777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0676d48-cc38-4136-9928-c84f12ef4a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.622057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0676d48-cc38-4136-9928-c84f12ef4a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.632240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0676d48-cc38-4136-9928-c84f12ef4a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:51.635030 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6df6eb-65fa-4bab-918e-62c8f1dd1f99 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:51.644790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 789/1575] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:51.646081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f47b7-3549-4569-af4a-1197fde3116a None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.646409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f47b7-3549-4569-af4a-1197fde3116a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.646687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f47b7-3549-4569-af4a-1197fde3116a None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.649376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 790/1576] 10.222.0.36 () {54 vars in 954 bytes} [Wed Oct 27 14:11:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:11:51.650280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908dec9-5c5e-457b-bc41-52d5cd0f3fa3 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.650573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908dec9-5c5e-457b-bc41-52d5cd0f3fa3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.650884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908dec9-5c5e-457b-bc41-52d5cd0f3fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.658570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0676d48-cc38-4136-9928-c84f12ef4a1e service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:51.670153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 787/1577] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:51.671458 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af983f8-de51-4d00-bc0d-4f6d109cd91a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.671925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af983f8-de51-4d00-bc0d-4f6d109cd91a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.672200 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af983f8-de51-4d00-bc0d-4f6d109cd91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.681166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1908dec9-5c5e-457b-bc41-52d5cd0f3fa3 None None] MFA Rules not processed for user `d33fa612914a45dca090798991b8dfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:51.683382 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1908dec9-5c5e-457b-bc41-52d5cd0f3fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:51.695960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6af983f8-de51-4d00-bc0d-4f6d109cd91a None None] MFA Rules not processed for user `a523c35d222f464e9d4f78ae990e3a17`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:51.697320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6af983f8-de51-4d00-bc0d-4f6d109cd91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:51.768886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 791/1578] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.770169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908dec9-5c5e-457b-bc41-52d5cd0f3fa3 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:51.789656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908dec9-5c5e-457b-bc41-52d5cd0f3fa3 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:51.795786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e081f8d-cdd5-4978-80e8-fe04ec1cecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:51.796943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e081f8d-cdd5-4978-80e8-fe04ec1cecaf admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.797388 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e081f8d-cdd5-4978-80e8-fe04ec1cecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.797757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e081f8d-cdd5-4978-80e8-fe04ec1cecaf admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.798632 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e081f8d-cdd5-4978-80e8-fe04ec1cecaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:51.803377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 788/1579] 10.222.0.36 () {58 vars in 1051 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.813602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af983f8-de51-4d00-bc0d-4f6d109cd91a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:51.827491 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af983f8-de51-4d00-bc0d-4f6d109cd91a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:51.830254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e081f8d-cdd5-4978-80e8-fe04ec1cecaf admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:51.834215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4989-b035-4690-ad78-92484e83afa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:51.835966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4989-b035-4690-ad78-92484e83afa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.836352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4989-b035-4690-ad78-92484e83afa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.836925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4989-b035-4690-ad78-92484e83afa3 admin admin] PATH_INFO: `/v3/projects/8c005467f59644588fbc67e6b66463d0/users/d7fb1495678547359359b3a6bbb07174/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.858847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 792/1580] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:11:51.860265 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bcbb0-62c0-47ac-a9f1-a9ad13619cc1 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:51.860564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bcbb0-62c0-47ac-a9f1-a9ad13619cc1 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:51.860856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bcbb0-62c0-47ac-a9f1-a9ad13619cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:51.867485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4989-b035-4690-ad78-92484e83afa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c005467f59644588fbc67e6b66463d0, user_id=d7fb1495678547359359b3a6bbb07174, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:51.909812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4989-b035-4690-ad78-92484e83afa3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:51.912826 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c40bcbb0-62c0-47ac-a9f1-a9ad13619cc1 None None] MFA Rules not processed for user `a523c35d222f464e9d4f78ae990e3a17`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:51.915328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c40bcbb0-62c0-47ac-a9f1-a9ad13619cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:51.927735 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 793/1581] 10.222.0.36 () {58 vars in 1051 bytes} [Wed Oct 27 14:11:51 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:51.929316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bcbb0-62c0-47ac-a9f1-a9ad13619cc1 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:51.941883 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 789/1582] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:51 2021] PUT /identity/v3/projects/8c005467f59644588fbc67e6b66463d0/users/d7fb1495678547359359b3a6bbb07174/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:51.942976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bcbb0-62c0-47ac-a9f1-a9ad13619cc1 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:51.943128 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4989-b035-4690-ad78-92484e83afa3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.050446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4989-b035-4690-ad78-92484e83afa3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:52.057030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777e5b5-7bb5-4584-bc31-36ca29e4e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.059599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777e5b5-7bb5-4584-bc31-36ca29e4e9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.059970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777e5b5-7bb5-4584-bc31-36ca29e4e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.061816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777e5b5-7bb5-4584-bc31-36ca29e4e9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.063334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7305a87-9036-423d-bf29-97c2b107a095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.063610 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777e5b5-7bb5-4584-bc31-36ca29e4e9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.063932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7305a87-9036-423d-bf29-97c2b107a095 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.064223 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7305a87-9036-423d-bf29-97c2b107a095 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.064505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7305a87-9036-423d-bf29-97c2b107a095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.117980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777e5b5-7bb5-4584-bc31-36ca29e4e9e8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:52.133405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 790/1583] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:51 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:52.134908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777e5b5-7bb5-4584-bc31-36ca29e4e9e8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.144640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7305a87-9036-423d-bf29-97c2b107a095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.150171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777e5b5-7bb5-4584-bc31-36ca29e4e9e8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:52.156623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce978-5cc1-47a5-8f8f-8622f97c4ed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.157593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce978-5cc1-47a5-8f8f-8622f97c4ed7 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.158178 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce978-5cc1-47a5-8f8f-8622f97c4ed7 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.158588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce978-5cc1-47a5-8f8f-8622f97c4ed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.179490 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7305a87-9036-423d-bf29-97c2b107a095 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:52.201205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 794/1584] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:51 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:52.204703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7305a87-9036-423d-bf29-97c2b107a095 service nova] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.243148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7305a87-9036-423d-bf29-97c2b107a095 service nova] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:52.257272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce978-5cc1-47a5-8f8f-8622f97c4ed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.258138 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a1abb-779b-42b7-ba1e-6507fdfcc9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.259375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1abb-779b-42b7-ba1e-6507fdfcc9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.259375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1abb-779b-42b7-ba1e-6507fdfcc9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.259375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1abb-779b-42b7-ba1e-6507fdfcc9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.260072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a1abb-779b-42b7-ba1e-6507fdfcc9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.292881 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce978-5cc1-47a5-8f8f-8622f97c4ed7 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:52.303589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 791/1585] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:52 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:52.304521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce978-5cc1-47a5-8f8f-8622f97c4ed7 service nova] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.315119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce978-5cc1-47a5-8f8f-8622f97c4ed7 service nova] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:52.318055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a1abb-779b-42b7-ba1e-6507fdfcc9d6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:52.320904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15703c-d2c0-4a95-986e-a304eabe8ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.322099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15703c-d2c0-4a95-986e-a304eabe8ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.322526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15703c-d2c0-4a95-986e-a304eabe8ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.323010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15703c-d2c0-4a95-986e-a304eabe8ce1 admin admin] PATH_INFO: `/v3/projects/398aa1e62d9040dca91e28f506f02412/users/7b37238935d54e208c6e03b38e005270/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.348096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 795/1586] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:52 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:52.349363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a1abb-779b-42b7-ba1e-6507fdfcc9d6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.351960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15703c-d2c0-4a95-986e-a304eabe8ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398aa1e62d9040dca91e28f506f02412, user_id=7b37238935d54e208c6e03b38e005270, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.368912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a1abb-779b-42b7-ba1e-6507fdfcc9d6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:52.380900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a556d-3d8d-4899-aeb6-90d3ed198197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.382780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a556d-3d8d-4899-aeb6-90d3ed198197 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.383055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a556d-3d8d-4899-aeb6-90d3ed198197 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.383606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a556d-3d8d-4899-aeb6-90d3ed198197 admin admin] PATH_INFO: `/v3/projects/8c005467f59644588fbc67e6b66463d0/users/d7fb1495678547359359b3a6bbb07174/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.387807 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a556d-3d8d-4899-aeb6-90d3ed198197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c005467f59644588fbc67e6b66463d0, user_id=d7fb1495678547359359b3a6bbb07174, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.393376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15703c-d2c0-4a95-986e-a304eabe8ce1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:52.419313 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 792/1587] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:52 2021] PUT /identity/v3/projects/398aa1e62d9040dca91e28f506f02412/users/7b37238935d54e208c6e03b38e005270/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:52.423227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15703c-d2c0-4a95-986e-a304eabe8ce1 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.453765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a556d-3d8d-4899-aeb6-90d3ed198197 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:52.482979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 796/1588] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:52 2021] PUT /identity/v3/projects/8c005467f59644588fbc67e6b66463d0/users/d7fb1495678547359359b3a6bbb07174/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:52.484078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a556d-3d8d-4899-aeb6-90d3ed198197 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.521533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15703c-d2c0-4a95-986e-a304eabe8ce1 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:52.620893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085ce99-2168-49ea-868b-6c48db2356c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.621517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085ce99-2168-49ea-868b-6c48db2356c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.621814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085ce99-2168-49ea-868b-6c48db2356c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.622103 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085ce99-2168-49ea-868b-6c48db2356c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.622910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085ce99-2168-49ea-868b-6c48db2356c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.667327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a556d-3d8d-4899-aeb6-90d3ed198197 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:52.674918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085ce99-2168-49ea-868b-6c48db2356c5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:52.690267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bc8ed-f609-4e17-848d-5aa4a0813e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.691129 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bc8ed-f609-4e17-848d-5aa4a0813e3f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.691563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bc8ed-f609-4e17-848d-5aa4a0813e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.692006 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bc8ed-f609-4e17-848d-5aa4a0813e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.693014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bc8ed-f609-4e17-848d-5aa4a0813e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.700851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 793/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:52 2021] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:52.706264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085ce99-2168-49ea-868b-6c48db2356c5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.728873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085ce99-2168-49ea-868b-6c48db2356c5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:52.740966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c3afe-4bbf-4e78-b44f-6669e70c24df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.743235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c3afe-4bbf-4e78-b44f-6669e70c24df admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.743536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c3afe-4bbf-4e78-b44f-6669e70c24df admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.743868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c3afe-4bbf-4e78-b44f-6669e70c24df admin admin] PATH_INFO: `/v3/projects/398aa1e62d9040dca91e28f506f02412/users/7b37238935d54e208c6e03b38e005270/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.747390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c3afe-4bbf-4e78-b44f-6669e70c24df admin admin] RBAC: Authorizing `identity:create_grant(project_id=398aa1e62d9040dca91e28f506f02412, user_id=7b37238935d54e208c6e03b38e005270, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.754581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bc8ed-f609-4e17-848d-5aa4a0813e3f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:52.791423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 797/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:52 2021] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:52.795975 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bc8ed-f609-4e17-848d-5aa4a0813e3f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.813558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c3afe-4bbf-4e78-b44f-6669e70c24df admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:52.816823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bc8ed-f609-4e17-848d-5aa4a0813e3f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:52.836755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f6d0f-ca6f-4a2a-a1fe-8295b1665233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:52.838356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f6d0f-ca6f-4a2a-a1fe-8295b1665233 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:52.838839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f6d0f-ca6f-4a2a-a1fe-8295b1665233 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:52.840897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f6d0f-ca6f-4a2a-a1fe-8295b1665233 admin admin] PATH_INFO: `/v3/projects/8c005467f59644588fbc67e6b66463d0/users/d7fb1495678547359359b3a6bbb07174/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:52.846696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 794/1591] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:52 2021] PUT /identity/v3/projects/398aa1e62d9040dca91e28f506f02412/users/7b37238935d54e208c6e03b38e005270/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:52.849012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c3afe-4bbf-4e78-b44f-6669e70c24df admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:52.851645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f6d0f-ca6f-4a2a-a1fe-8295b1665233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c005467f59644588fbc67e6b66463d0, user_id=d7fb1495678547359359b3a6bbb07174, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:52.961384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f6d0f-ca6f-4a2a-a1fe-8295b1665233 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:53.005265 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 798/1592] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:52 2021] PUT /identity/v3/projects/8c005467f59644588fbc67e6b66463d0/users/d7fb1495678547359359b3a6bbb07174/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:53.006291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f6d0f-ca6f-4a2a-a1fe-8295b1665233 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:53.048486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c3afe-4bbf-4e78-b44f-6669e70c24df admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:53.105281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f6d0f-ca6f-4a2a-a1fe-8295b1665233 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:53.110065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e978cb3-a116-4638-a2dc-5090ff6df973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:53.110803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e978cb3-a116-4638-a2dc-5090ff6df973 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.111241 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e978cb3-a116-4638-a2dc-5090ff6df973 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.111513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e978cb3-a116-4638-a2dc-5090ff6df973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.159303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20ea26-986e-42f0-9452-5650633679ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:53.159857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ea26-986e-42f0-9452-5650633679ef admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.160116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ea26-986e-42f0-9452-5650633679ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.160404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ea26-986e-42f0-9452-5650633679ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.161111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20ea26-986e-42f0-9452-5650633679ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:53.188075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20ea26-986e-42f0-9452-5650633679ef admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:53.199515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 795/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:52 2021] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:53.200922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324924-99a5-4350-9934-ec94b7cf4def None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.201225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324924-99a5-4350-9934-ec94b7cf4def None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.201513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324924-99a5-4350-9934-ec94b7cf4def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.207570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e978cb3-a116-4638-a2dc-5090ff6df973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:53.243949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-d9324924-99a5-4350-9934-ec94b7cf4def None None] MFA Rules not processed for user `d7fb1495678547359359b3a6bbb07174`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:53.244132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e978cb3-a116-4638-a2dc-5090ff6df973 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:53.245788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d9324924-99a5-4350-9934-ec94b7cf4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:53.262932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 799/1594] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:53 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:53.264982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7cb5b-e2da-43fe-ad35-b3ab43574f7a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.265651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7cb5b-e2da-43fe-ad35-b3ab43574f7a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.265761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7cb5b-e2da-43fe-ad35-b3ab43574f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.318186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-82b7cb5b-e2da-43fe-ad35-b3ab43574f7a None None] MFA Rules not processed for user `231001befca04f798ca7e580825b19b2`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:53.320554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-82b7cb5b-e2da-43fe-ad35-b3ab43574f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:53.347316 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 796/1595] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:53 2021] POST /identity/v3/auth/tokens => generated 3767 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:53.353740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ea53-6020-4521-ac0d-e573fd3e9214 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.354115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ea53-6020-4521-ac0d-e573fd3e9214 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.354472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ea53-6020-4521-ac0d-e573fd3e9214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.407713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5031ea53-6020-4521-ac0d-e573fd3e9214 None None] MFA Rules not processed for user `2083abdeeae44796af8b84b757a3855e`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:53.409002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5031ea53-6020-4521-ac0d-e573fd3e9214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:53.420532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 800/1596] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:53 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:53.433170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7cb5b-e2da-43fe-ad35-b3ab43574f7a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:53.442665 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7cb5b-e2da-43fe-ad35-b3ab43574f7a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:53.447146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140c745-d16b-4e2b-b464-a6c6e193028a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:53.447815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140c745-d16b-4e2b-b464-a6c6e193028a service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.448172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140c745-d16b-4e2b-b464-a6c6e193028a service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.448525 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140c745-d16b-4e2b-b464-a6c6e193028a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.460353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140c745-d16b-4e2b-b464-a6c6e193028a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:53.492729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140c745-d16b-4e2b-b464-a6c6e193028a service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:53.509554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 801/1597] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:53 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:53.510791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140c745-d16b-4e2b-b464-a6c6e193028a service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:53.524773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140c745-d16b-4e2b-b464-a6c6e193028a service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:53.531658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231bc0-cbf2-4413-a8fe-6ffd2acbbabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:53.532840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231bc0-cbf2-4413-a8fe-6ffd2acbbabb admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.532985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231bc0-cbf2-4413-a8fe-6ffd2acbbabb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.533506 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231bc0-cbf2-4413-a8fe-6ffd2acbbabb admin admin] PATH_INFO: `/v3/projects/398aa1e62d9040dca91e28f506f02412/users/7b37238935d54e208c6e03b38e005270/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.535971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c231bc0-cbf2-4413-a8fe-6ffd2acbbabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=398aa1e62d9040dca91e28f506f02412, user_id=7b37238935d54e208c6e03b38e005270, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:53.573444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c231bc0-cbf2-4413-a8fe-6ffd2acbbabb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:53.590438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 797/1598] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:53 2021] POST /identity/v3/auth/tokens => generated 3712 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:53.592114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 802/1599] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:53 2021] PUT /identity/v3/projects/398aa1e62d9040dca91e28f506f02412/users/7b37238935d54e208c6e03b38e005270/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:53.595916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231bc0-cbf2-4413-a8fe-6ffd2acbbabb admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:53.608002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f4b0e-5c26-4117-aaaa-c938274bb0c9 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.608348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f4b0e-5c26-4117-aaaa-c938274bb0c9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.608635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f4b0e-5c26-4117-aaaa-c938274bb0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.640512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-fc7f4b0e-5c26-4117-aaaa-c938274bb0c9 None None] MFA Rules not processed for user `231001befca04f798ca7e580825b19b2`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:53.642469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fc7f4b0e-5c26-4117-aaaa-c938274bb0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:53.746567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231bc0-cbf2-4413-a8fe-6ffd2acbbabb admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:53.751278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 798/1600] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:53 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:53.758223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235fd21-e202-4846-8313-f4b219de658a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.758553 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235fd21-e202-4846-8313-f4b219de658a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.758872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235fd21-e202-4846-8313-f4b219de658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.764345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a7b10-ff20-4fb3-a0b4-4ea2458ddbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:53.764964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a7b10-ff20-4fb3-a0b4-4ea2458ddbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:53.765258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a7b10-ff20-4fb3-a0b4-4ea2458ddbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:53.765540 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a7b10-ff20-4fb3-a0b4-4ea2458ddbf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:53.766225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a7b10-ff20-4fb3-a0b4-4ea2458ddbf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:53.836193 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a7b10-ff20-4fb3-a0b4-4ea2458ddbf7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:53.854136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e235fd21-e202-4846-8313-f4b219de658a None None] MFA Rules not processed for user `7b37238935d54e208c6e03b38e005270`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:53.855358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e235fd21-e202-4846-8313-f4b219de658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:53.893556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 803/1601] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:11:53 2021] POST /identity/v3/projects => generated 405 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:11:53.897613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a7b10-ff20-4fb3-a0b4-4ea2458ddbf7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:54.081414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 799/1602] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:53 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:54.092967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a7b10-ff20-4fb3-a0b4-4ea2458ddbf7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:54.107661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec170ce6-4694-4f7c-a851-f184137f2417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:54.108289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec170ce6-4694-4f7c-a851-f184137f2417 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:54.108577 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec170ce6-4694-4f7c-a851-f184137f2417 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:54.108862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec170ce6-4694-4f7c-a851-f184137f2417 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:54.110004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec170ce6-4694-4f7c-a851-f184137f2417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:54.159977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235fd21-e202-4846-8313-f4b219de658a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:54.187566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec170ce6-4694-4f7c-a851-f184137f2417 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:54.234786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 804/1603] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:11:53 2021] POST /identity/v3/users => generated 309 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:11:54.236245 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec170ce6-4694-4f7c-a851-f184137f2417 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:54.255454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec170ce6-4694-4f7c-a851-f184137f2417 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:54.269808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac0746-1fc1-4a0a-a83d-aa0690f2d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:54.271049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac0746-1fc1-4a0a-a83d-aa0690f2d600 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:54.271792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac0746-1fc1-4a0a-a83d-aa0690f2d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:54.272825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac0746-1fc1-4a0a-a83d-aa0690f2d600 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:54.274757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac0746-1fc1-4a0a-a83d-aa0690f2d600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:54.298855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235fd21-e202-4846-8313-f4b219de658a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:54.346351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac0746-1fc1-4a0a-a83d-aa0690f2d600 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:54.364488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 805/1604] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:54 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:54.365544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac0746-1fc1-4a0a-a83d-aa0690f2d600 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:54.454066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b2ace-9d43-4e3a-8c9c-9d7397a6b53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:54.454785 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b2ace-9d43-4e3a-8c9c-9d7397a6b53a service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:54.455136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b2ace-9d43-4e3a-8c9c-9d7397a6b53a service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:54.455480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b2ace-9d43-4e3a-8c9c-9d7397a6b53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:54.506080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac0746-1fc1-4a0a-a83d-aa0690f2d600 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:54.510918 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d48b-addd-4f76-a69f-394d7a08f8ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:54.511748 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d48b-addd-4f76-a69f-394d7a08f8ca service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:54.512233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d48b-addd-4f76-a69f-394d7a08f8ca service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:54.512652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d48b-addd-4f76-a69f-394d7a08f8ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:54.575257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b2ace-9d43-4e3a-8c9c-9d7397a6b53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:54.609745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b2ace-9d43-4e3a-8c9c-9d7397a6b53a service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:54.613570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d48b-addd-4f76-a69f-394d7a08f8ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:54.621931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 800/1605] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:54 2021] GET /identity/v3/auth/tokens => generated 3767 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:11:54.622696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b2ace-9d43-4e3a-8c9c-9d7397a6b53a service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:54.643385 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b2ace-9d43-4e3a-8c9c-9d7397a6b53a service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:54.651438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d48b-addd-4f76-a69f-394d7a08f8ca service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:54.664688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8d7a9-fc43-46f6-baad-c227ea623955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:54.665532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8d7a9-fc43-46f6-baad-c227ea623955 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:54.665828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8d7a9-fc43-46f6-baad-c227ea623955 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:54.666118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8d7a9-fc43-46f6-baad-c227ea623955 admin admin] PATH_INFO: `/v3/projects/ca1691bd4d614bb6982f3683df928465/users/d83074f631d048489d713cf7b45a6976/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:54.680544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 806/1606] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:54 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:54.714744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8d7a9-fc43-46f6-baad-c227ea623955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1691bd4d614bb6982f3683df928465, user_id=d83074f631d048489d713cf7b45a6976, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:54.772970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8d7a9-fc43-46f6-baad-c227ea623955 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:54.804335 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 801/1607] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:54 2021] PUT /identity/v3/projects/ca1691bd4d614bb6982f3683df928465/users/d83074f631d048489d713cf7b45a6976/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:54.809184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d48b-addd-4f76-a69f-394d7a08f8ca service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:54.827832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d48b-addd-4f76-a69f-394d7a08f8ca service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:54.862727 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8d7a9-fc43-46f6-baad-c227ea623955 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:54.947322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c32f9-ee7f-4dd0-9490-b1faa22ab3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:54.948329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c32f9-ee7f-4dd0-9490-b1faa22ab3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:54.948895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c32f9-ee7f-4dd0-9490-b1faa22ab3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:54.949371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c32f9-ee7f-4dd0-9490-b1faa22ab3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:54.950358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c32f9-ee7f-4dd0-9490-b1faa22ab3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:54.998697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c32f9-ee7f-4dd0-9490-b1faa22ab3b3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:55.002400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8d7a9-fc43-46f6-baad-c227ea623955 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:55.012342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc3263-e295-42a9-9d1c-e2b9d4878fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:55.016122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 807/1608] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:54 2021] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:55.016122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c32f9-ee7f-4dd0-9490-b1faa22ab3b3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:55.017349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc3263-e295-42a9-9d1c-e2b9d4878fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:55.017804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc3263-e295-42a9-9d1c-e2b9d4878fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:55.018192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc3263-e295-42a9-9d1c-e2b9d4878fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:55.100239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc3263-e295-42a9-9d1c-e2b9d4878fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:55.125903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c32f9-ee7f-4dd0-9490-b1faa22ab3b3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:55.128715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc3263-e295-42a9-9d1c-e2b9d4878fb3 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:55.132578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72440ddd-024d-4d2a-92a3-4a7b560daf38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:55.132884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72440ddd-024d-4d2a-92a3-4a7b560daf38 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:55.133335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72440ddd-024d-4d2a-92a3-4a7b560daf38 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:55.133630 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72440ddd-024d-4d2a-92a3-4a7b560daf38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:55.138925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 802/1609] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:54 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:55.139757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc3263-e295-42a9-9d1c-e2b9d4878fb3 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:55.152163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc3263-e295-42a9-9d1c-e2b9d4878fb3 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:55.157074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49434b-7077-4811-ad9f-c80dfed4a8dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:55.157662 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49434b-7077-4811-ad9f-c80dfed4a8dc service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:55.157950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49434b-7077-4811-ad9f-c80dfed4a8dc service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:55.158231 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49434b-7077-4811-ad9f-c80dfed4a8dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:55.281580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72440ddd-024d-4d2a-92a3-4a7b560daf38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:55.324170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49434b-7077-4811-ad9f-c80dfed4a8dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:55.340028 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72440ddd-024d-4d2a-92a3-4a7b560daf38 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:55.351461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49434b-7077-4811-ad9f-c80dfed4a8dc service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:55.367203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 808/1610] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:55 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:55.368393 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72440ddd-024d-4d2a-92a3-4a7b560daf38 service nova] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:55.372437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 803/1611] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:55 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:55.373400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49434b-7077-4811-ad9f-c80dfed4a8dc service nova] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:55.393128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72440ddd-024d-4d2a-92a3-4a7b560daf38 service nova] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:55.397544 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49434b-7077-4811-ad9f-c80dfed4a8dc service nova] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:55.401421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b06a26-a33a-42c9-aea2-fa7c02f3073f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:55.402245 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b06a26-a33a-42c9-aea2-fa7c02f3073f service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:55.402749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b06a26-a33a-42c9-aea2-fa7c02f3073f service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:55.403195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b06a26-a33a-42c9-aea2-fa7c02f3073f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:55.407416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdf1bd-1fa3-474d-8954-c3f854b8fa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:55.408295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf1bd-1fa3-474d-8954-c3f854b8fa37 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:55.408579 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf1bd-1fa3-474d-8954-c3f854b8fa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:55.408860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf1bd-1fa3-474d-8954-c3f854b8fa37 admin admin] PATH_INFO: `/v3/projects/ca1691bd4d614bb6982f3683df928465/users/d83074f631d048489d713cf7b45a6976/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:55.411598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdf1bd-1fa3-474d-8954-c3f854b8fa37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1691bd4d614bb6982f3683df928465, user_id=d83074f631d048489d713cf7b45a6976, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:55.467908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdf1bd-1fa3-474d-8954-c3f854b8fa37 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:55.499764 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 804/1612] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:55 2021] PUT /identity/v3/projects/ca1691bd4d614bb6982f3683df928465/users/d83074f631d048489d713cf7b45a6976/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:11:55.505297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdf1bd-1fa3-474d-8954-c3f854b8fa37 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:55.595484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b06a26-a33a-42c9-aea2-fa7c02f3073f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:55.654159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdf1bd-1fa3-474d-8954-c3f854b8fa37 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:55.661067 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50f132-b5a9-432f-9997-3393ed3276c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:55.661952 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50f132-b5a9-432f-9997-3393ed3276c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:55.662452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50f132-b5a9-432f-9997-3393ed3276c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:55.663783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50f132-b5a9-432f-9997-3393ed3276c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:55.664788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50f132-b5a9-432f-9997-3393ed3276c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:55.669857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b06a26-a33a-42c9-aea2-fa7c02f3073f service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:55.694123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50f132-b5a9-432f-9997-3393ed3276c2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:55.704316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 809/1613] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:55 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:55.712082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 805/1614] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:11:55 2021] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:11:55.712271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b06a26-a33a-42c9-aea2-fa7c02f3073f service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:55.729707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b06a26-a33a-42c9-aea2-fa7c02f3073f service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:55.735811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68f64a-e595-4435-82cb-1c078e4cbea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:55.736660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f64a-e595-4435-82cb-1c078e4cbea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:55.736951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f64a-e595-4435-82cb-1c078e4cbea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:55.737499 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f64a-e595-4435-82cb-1c078e4cbea9 admin admin] PATH_INFO: `/v3/projects/ca1691bd4d614bb6982f3683df928465/users/d83074f631d048489d713cf7b45a6976/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:55.742938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68f64a-e595-4435-82cb-1c078e4cbea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1691bd4d614bb6982f3683df928465, user_id=d83074f631d048489d713cf7b45a6976, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:55.808494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68f64a-e595-4435-82cb-1c078e4cbea9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:55.837069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 810/1615] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:11:55 2021] PUT /identity/v3/projects/ca1691bd4d614bb6982f3683df928465/users/d83074f631d048489d713cf7b45a6976/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:11:56.550524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8c5b-3ec3-4fd0-8543-361dfac6d039 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:56.551076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8c5b-3ec3-4fd0-8543-361dfac6d039 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:56.551076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8c5b-3ec3-4fd0-8543-361dfac6d039 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:56.558534 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 806/1616] 10.222.0.36 () {54 vars in 912 bytes} [Wed Oct 27 14:11:56 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:11:56.564719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0a84-5012-4b41-9822-c561fc0e876c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:56.565779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0a84-5012-4b41-9822-c561fc0e876c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:56.565779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a0a84-5012-4b41-9822-c561fc0e876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:56.675261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11c77d-93af-4697-9b39-01ed5b6288d0 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:56.675586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11c77d-93af-4697-9b39-01ed5b6288d0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:56.675714 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-e20a0a84-5012-4b41-9822-c561fc0e876c None None] MFA Rules not processed for user `dea5ec2125f0468baa1e15a429021e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:56.675883 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11c77d-93af-4697-9b39-01ed5b6288d0 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:56.677990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 807/1617] 10.222.0.36 () {54 vars in 912 bytes} [Wed Oct 27 14:11:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:11:56.679510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e20a0a84-5012-4b41-9822-c561fc0e876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:56.683741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf17d-d771-4ca7-be38-7a5b3a6c4911 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:56.684059 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf17d-d771-4ca7-be38-7a5b3a6c4911 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:56.684372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf17d-d771-4ca7-be38-7a5b3a6c4911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:56.723060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7aeaf17d-d771-4ca7-be38-7a5b3a6c4911 None None] MFA Rules not processed for user `dea5ec2125f0468baa1e15a429021e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:56.724543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7aeaf17d-d771-4ca7-be38-7a5b3a6c4911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:56.791074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 811/1618] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Oct 27 14:11:56 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:11:56.812644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 808/1619] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Oct 27 14:11:56 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:11:56.816075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a0a84-5012-4b41-9822-c561fc0e876c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:56.829763 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a0a84-5012-4b41-9822-c561fc0e876c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:56.833731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adfc7a-656b-4c92-b46b-c2158845d172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:56.834422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adfc7a-656b-4c92-b46b-c2158845d172 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:56.835402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adfc7a-656b-4c92-b46b-c2158845d172 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:56.835773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adfc7a-656b-4c92-b46b-c2158845d172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:56.847394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adfc7a-656b-4c92-b46b-c2158845d172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:56.852248 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf17d-d771-4ca7-be38-7a5b3a6c4911 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:56.865691 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf17d-d771-4ca7-be38-7a5b3a6c4911 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:56.876543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c8a5f-61cf-4056-90fd-c6628bd77a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:56.879363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8a5f-61cf-4056-90fd-c6628bd77a37 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:56.879733 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8a5f-61cf-4056-90fd-c6628bd77a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:56.880145 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8a5f-61cf-4056-90fd-c6628bd77a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:56.887507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adfc7a-656b-4c92-b46b-c2158845d172 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:56.897673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c8a5f-61cf-4056-90fd-c6628bd77a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:56.905369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 812/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:56 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:56.924219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c8a5f-61cf-4056-90fd-c6628bd77a37 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:56.934403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 809/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:56 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:11:58.830915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136eb49-3de4-4a20-9f64-30a7f878c3eb None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:58.831431 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136eb49-3de4-4a20-9f64-30a7f878c3eb None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:58.831513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136eb49-3de4-4a20-9f64-30a7f878c3eb None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:58.833267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 813/1622] 10.222.0.36 () {54 vars in 960 bytes} [Wed Oct 27 14:11:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:11:58.839609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d389062-46bf-4f6b-bb86-7b0f55a64a89 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:58.840144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d389062-46bf-4f6b-bb86-7b0f55a64a89 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:58.840236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d389062-46bf-4f6b-bb86-7b0f55a64a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:58.919535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6d389062-46bf-4f6b-bb86-7b0f55a64a89 None None] MFA Rules not processed for user `78404f52618b4d86a2a478f18b136773`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:58.920686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6d389062-46bf-4f6b-bb86-7b0f55a64a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:58.957011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926295e-af02-4948-aa2c-63bbc3397144 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:58.957374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926295e-af02-4948-aa2c-63bbc3397144 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:58.957664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926295e-af02-4948-aa2c-63bbc3397144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:59.105420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2926295e-af02-4948-aa2c-63bbc3397144 None None] MFA Rules not processed for user `d83074f631d048489d713cf7b45a6976`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:11:59.107695 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2926295e-af02-4948-aa2c-63bbc3397144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:59.244157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 810/1623] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Oct 27 14:11:58 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:11:59.246865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d389062-46bf-4f6b-bb86-7b0f55a64a89 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:59.273257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d389062-46bf-4f6b-bb86-7b0f55a64a89 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:59.283235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce764774-6ecb-4d24-9bbd-e99ca3d8541a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:59.285657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764774-6ecb-4d24-9bbd-e99ca3d8541a service placement] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:59.286047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764774-6ecb-4d24-9bbd-e99ca3d8541a service placement] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:59.286578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764774-6ecb-4d24-9bbd-e99ca3d8541a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:59.292326 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ce764774-6ecb-4d24-9bbd-e99ca3d8541a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:59.326315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce764774-6ecb-4d24-9bbd-e99ca3d8541a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:59.361255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 814/1624] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:11:58 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:11:59.361255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926295e-af02-4948-aa2c-63bbc3397144 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:59.389142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926295e-af02-4948-aa2c-63bbc3397144 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:59.396257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce764774-6ecb-4d24-9bbd-e99ca3d8541a service placement] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:59.399931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63c217-57a0-4221-af4c-6680b59f90c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:59.401325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c217-57a0-4221-af4c-6680b59f90c6 service placement] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:59.401411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c217-57a0-4221-af4c-6680b59f90c6 service placement] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:59.401679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c217-57a0-4221-af4c-6680b59f90c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:59.428221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63c217-57a0-4221-af4c-6680b59f90c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:59.442118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 811/1625] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:59 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:59.519984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63c217-57a0-4221-af4c-6680b59f90c6 service placement] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:11:59.551914 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 815/1626] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:59 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:11:59.856142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce764774-6ecb-4d24-9bbd-e99ca3d8541a service placement] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:11:59.871446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce764774-6ecb-4d24-9bbd-e99ca3d8541a service placement] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:11:59.886205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34d49b-4875-42a3-887e-1959997fcfbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:11:59.886856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34d49b-4875-42a3-887e-1959997fcfbc service placement] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:11:59.887297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34d49b-4875-42a3-887e-1959997fcfbc service placement] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:11:59.887588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34d49b-4875-42a3-887e-1959997fcfbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:11:59.889370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8c34d49b-4875-42a3-887e-1959997fcfbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:11:59.924481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34d49b-4875-42a3-887e-1959997fcfbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:11:59.999704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34d49b-4875-42a3-887e-1959997fcfbc service placement] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:00.049331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 812/1627] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:11:59 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:01.355736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a816d-f544-4aa0-acb0-7209c4eed3bb None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:01.356273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a816d-f544-4aa0-acb0-7209c4eed3bb None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:01.356688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a816d-f544-4aa0-acb0-7209c4eed3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:01.416350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-e42a816d-f544-4aa0-acb0-7209c4eed3bb None None] MFA Rules not processed for user `45b340bfc21940979721e201c67e12a6`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:01.417656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e42a816d-f544-4aa0-acb0-7209c4eed3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:01.508403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34d49b-4875-42a3-887e-1959997fcfbc service placement] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:01.524900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 816/1628] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:01 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:01.535530 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a816d-f544-4aa0-acb0-7209c4eed3bb None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:01.697318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34d49b-4875-42a3-887e-1959997fcfbc service placement] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:01.706907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:01.707738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:01.708025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:01.708500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] PATH_INFO: `/v3/users/d2795429673642c5bd5547bf29281946` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:01.711010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2795429673642c5bd5547bf29281946)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:01.742503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a816d-f544-4aa0-acb0-7209c4eed3bb None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:01.747898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0040d7-8b77-48dd-b78e-1d57b163cb41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:01.748498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0040d7-8b77-48dd-b78e-1d57b163cb41 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:01.748791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0040d7-8b77-48dd-b78e-1d57b163cb41 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:01.749085 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0040d7-8b77-48dd-b78e-1d57b163cb41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:01.767526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0040d7-8b77-48dd-b78e-1d57b163cb41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:01.773698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: WARNING py.warnings [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:12:01.773698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: warnings.warn(msg) Oct 27 14:12:01.773698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: Oct 27 14:12:01.775391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:01.811031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0040d7-8b77-48dd-b78e-1d57b163cb41 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:01.835635 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 817/1629] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:01 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:01.929593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2795429673642c5bd5547bf29281946'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:01.961878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2795429673642c5bd5547bf29281946'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:01.963402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2795429673642c5bd5547bf29281946'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:02.002267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2795429673642c5bd5547bf29281946'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:02.014004 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2795429673642c5bd5547bf29281946'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:02.025754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 813/1630] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:01 2021] DELETE /identity/v3/users/d2795429673642c5bd5547bf29281946 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:02.030239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39468-687e-449f-9bde-b1fa10293ca0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:02.030535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39468-687e-449f-9bde-b1fa10293ca0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:02.030900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39468-687e-449f-9bde-b1fa10293ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:02.080681 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-eec39468-687e-449f-9bde-b1fa10293ca0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:02.081929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-eec39468-687e-449f-9bde-b1fa10293ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:02.176264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 818/1631] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:02.187211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:02.188585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:02.307830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d17be-3aac-4342-b9f4-1f7e7b9e4ede admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:02.312203 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42326cc0-0f86-4d0c-87d4-ece97e48fc90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:02.313027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42326cc0-0f86-4d0c-87d4-ece97e48fc90 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:02.313528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42326cc0-0f86-4d0c-87d4-ece97e48fc90 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:02.314057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42326cc0-0f86-4d0c-87d4-ece97e48fc90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:02.326747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42326cc0-0f86-4d0c-87d4-ece97e48fc90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:02.369245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42326cc0-0f86-4d0c-87d4-ece97e48fc90 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:02.383641 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 814/1632] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:03.206264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec39468-687e-449f-9bde-b1fa10293ca0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:03.208039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-eec39468-687e-449f-9bde-b1fa10293ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:03.233113 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42326cc0-0f86-4d0c-87d4-ece97e48fc90 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:03.238530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-42326cc0-0f86-4d0c-87d4-ece97e48fc90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:03.266105 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec39468-687e-449f-9bde-b1fa10293ca0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:03.271634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:03.273708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:03.274171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:03.274780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] PATH_INFO: `/v3/users/2083abdeeae44796af8b84b757a3855e` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:03.276174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2083abdeeae44796af8b84b757a3855e)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:03.280016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42326cc0-0f86-4d0c-87d4-ece97e48fc90 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:03.292985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:03.294462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:03.294799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:03.297020 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] PATH_INFO: `/v3/projects/161bb4893aa14d7b83cfc4b20cb9846a` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:03.300302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=161bb4893aa14d7b83cfc4b20cb9846a)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:03.321070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:03.361023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:03.450687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161bb4893aa14d7b83cfc4b20cb9846a', 'request_id': 'req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.454845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2083abdeeae44796af8b84b757a3855e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.470085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161bb4893aa14d7b83cfc4b20cb9846a', 'request_id': 'req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.485551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161bb4893aa14d7b83cfc4b20cb9846a', 'request_id': 'req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.488648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2083abdeeae44796af8b84b757a3855e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.491798 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2083abdeeae44796af8b84b757a3855e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.516941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2083abdeeae44796af8b84b757a3855e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.525798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] The token cache is being invalidate because project 161bb4893aa14d7b83cfc4b20cb9846a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:03.529222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.532384 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.535228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2083abdeeae44796af8b84b757a3855e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:03.539747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 815/1633] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:03 2021] DELETE /identity/v3/projects/161bb4893aa14d7b83cfc4b20cb9846a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:03.542570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:03.546986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:03.548792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 819/1634] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:03 2021] DELETE /identity/v3/users/2083abdeeae44796af8b84b757a3855e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:03.813325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892c5e0-5c54-4253-ba0b-c3f08c89fe4a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:03.905186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:03.906075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:03.906376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:03.907078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] PATH_INFO: `/v3/users/d7fb1495678547359359b3a6bbb07174` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:03.907828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fb1495678547359359b3a6bbb07174)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:03.948677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:04.035111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fb1495678547359359b3a6bbb07174'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.066421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fb1495678547359359b3a6bbb07174'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.067482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fb1495678547359359b3a6bbb07174'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.076557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fb1495678547359359b3a6bbb07174'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.084972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fb1495678547359359b3a6bbb07174'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.092099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 816/1635] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:03 2021] DELETE /identity/v3/users/d7fb1495678547359359b3a6bbb07174 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:04.106343 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:04.107796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:04.120830 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a61cb3-86c1-48f9-bb04-8edb109b71f6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:04.187230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:04.188357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:04.188643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:04.188930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] PATH_INFO: `/v3/projects/71891beeb9cf4a9a95067ff34e318014` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:04.190022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71891beeb9cf4a9a95067ff34e318014)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:04.216015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: WARNING py.warnings [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:12:04.216015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: warnings.warn(msg) Oct 27 14:12:04.216015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: Oct 27 14:12:04.217225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:04.282883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71891beeb9cf4a9a95067ff34e318014', 'request_id': 'req-a494aafd-bfca-411a-b06e-f75e67b2cda1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.297556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71891beeb9cf4a9a95067ff34e318014', 'request_id': 'req-a494aafd-bfca-411a-b06e-f75e67b2cda1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.305896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71891beeb9cf4a9a95067ff34e318014', 'request_id': 'req-a494aafd-bfca-411a-b06e-f75e67b2cda1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.318839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] The token cache is being invalidate because project 71891beeb9cf4a9a95067ff34e318014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:04.320465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.323084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.328263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 820/1636] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:04 2021] DELETE /identity/v3/projects/71891beeb9cf4a9a95067ff34e318014 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:04.329363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:04.330781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:04.363640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351790be-031c-45f3-9fd9-01f4d7d951e2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:04.445793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:04.446719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:04.447074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:04.447424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] PATH_INFO: `/v3/users/d83074f631d048489d713cf7b45a6976` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:04.448609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83074f631d048489d713cf7b45a6976)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:04.474767 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:04.526836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83074f631d048489d713cf7b45a6976'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.539557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83074f631d048489d713cf7b45a6976'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.540238 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83074f631d048489d713cf7b45a6976'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.552724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83074f631d048489d713cf7b45a6976'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.560828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-71d34233-edbd-48ab-b935-21a31671962b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83074f631d048489d713cf7b45a6976'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:04.568177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 817/1637] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:04 2021] DELETE /identity/v3/users/d83074f631d048489d713cf7b45a6976 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:04.817910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:04.819589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:04.832539 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494aafd-bfca-411a-b06e-f75e67b2cda1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:04.917373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:04.918259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:04.918653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:04.919021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] PATH_INFO: `/v3/projects/8c005467f59644588fbc67e6b66463d0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:04.920189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c005467f59644588fbc67e6b66463d0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:04.946749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.002852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c005467f59644588fbc67e6b66463d0', 'request_id': 'req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.015919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c005467f59644588fbc67e6b66463d0', 'request_id': 'req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.026789 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c005467f59644588fbc67e6b66463d0', 'request_id': 'req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.044829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] The token cache is being invalidate because project 8c005467f59644588fbc67e6b66463d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:05.045638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.046362 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d8cd261b-5c08-470f-bf33-d2b1b702c9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.050739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 821/1638] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:04 2021] DELETE /identity/v3/projects/8c005467f59644588fbc67e6b66463d0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:05.055036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e171d-8fb6-4ca5-bf19-5a9d0ed504f5 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.055226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e171d-8fb6-4ca5-bf19-5a9d0ed504f5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.055568 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e171d-8fb6-4ca5-bf19-5a9d0ed504f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.086399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-023e171d-8fb6-4ca5-bf19-5a9d0ed504f5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:05.087830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-023e171d-8fb6-4ca5-bf19-5a9d0ed504f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:05.171292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 818/1639] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:05.179909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d203523-5450-4b31-b7c9-86dc5bcfcc89 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.180207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d203523-5450-4b31-b7c9-86dc5bcfcc89 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.180493 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d203523-5450-4b31-b7c9-86dc5bcfcc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.195341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e171d-8fb6-4ca5-bf19-5a9d0ed504f5 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.196671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-023e171d-8fb6-4ca5-bf19-5a9d0ed504f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:05.203938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2d203523-5450-4b31-b7c9-86dc5bcfcc89 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:05.205097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2d203523-5450-4b31-b7c9-86dc5bcfcc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:05.209261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e171d-8fb6-4ca5-bf19-5a9d0ed504f5 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.213725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 822/1640] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:05.215242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.216162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.216538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.216973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] PATH_INFO: `/v3/projects/ca1691bd4d614bb6982f3683df928465` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.217661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d203523-5450-4b31-b7c9-86dc5bcfcc89 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.218280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1691bd4d614bb6982f3683df928465)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.227631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d203523-5450-4b31-b7c9-86dc5bcfcc89 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.232375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11e4d-4088-48f8-8460-18582d19a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.233248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11e4d-4088-48f8-8460-18582d19a421 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.233878 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11e4d-4088-48f8-8460-18582d19a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.234330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11e4d-4088-48f8-8460-18582d19a421 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.235193 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11e4d-4088-48f8-8460-18582d19a421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:05.236355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11e4d-4088-48f8-8460-18582d19a421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.245632 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.266391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11e4d-4088-48f8-8460-18582d19a421 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.281926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 823/1641] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:05.286539 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11e4d-4088-48f8-8460-18582d19a421 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.303936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11e4d-4088-48f8-8460-18582d19a421 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.307455 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1691bd4d614bb6982f3683df928465', 'request_id': 'req-700976d6-310f-430d-8c86-d48b73fc04cd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.318096 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1691bd4d614bb6982f3683df928465', 'request_id': 'req-700976d6-310f-430d-8c86-d48b73fc04cd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.326680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1691bd4d614bb6982f3683df928465', 'request_id': 'req-700976d6-310f-430d-8c86-d48b73fc04cd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.338960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] The token cache is being invalidate because project ca1691bd4d614bb6982f3683df928465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:05.339571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.340064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-700976d6-310f-430d-8c86-d48b73fc04cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:05.342007 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 819/1642] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:05 2021] DELETE /identity/v3/projects/ca1691bd4d614bb6982f3683df928465 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:05.346505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc518-b095-4bbd-997e-e0a6f48b3289 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.346948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc518-b095-4bbd-997e-e0a6f48b3289 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.347325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc518-b095-4bbd-997e-e0a6f48b3289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.370288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-641dc518-b095-4bbd-997e-e0a6f48b3289 None None] MFA Rules not processed for user `45b340bfc21940979721e201c67e12a6`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:05.371513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-641dc518-b095-4bbd-997e-e0a6f48b3289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:05.376541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cfee9-d46b-4043-9bc4-b3c82e2bfc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.377198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cfee9-d46b-4043-9bc4-b3c82e2bfc8b admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.377552 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cfee9-d46b-4043-9bc4-b3c82e2bfc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.377902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cfee9-d46b-4043-9bc4-b3c82e2bfc8b admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.378601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cfee9-d46b-4043-9bc4-b3c82e2bfc8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.405684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cfee9-d46b-4043-9bc4-b3c82e2bfc8b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.433504 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 824/1643] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:05.435181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0e2e2-4635-4068-9b74-d388ea65e73f None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.435480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0e2e2-4635-4068-9b74-d388ea65e73f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.435806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0e2e2-4635-4068-9b74-d388ea65e73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.439564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 820/1644] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:05.445056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc518-b095-4bbd-997e-e0a6f48b3289 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.445056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-641dc518-b095-4bbd-997e-e0a6f48b3289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:05.455219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc518-b095-4bbd-997e-e0a6f48b3289 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.461454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-d7b0e2e2-4635-4068-9b74-d388ea65e73f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:05.462778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d7b0e2e2-4635-4068-9b74-d388ea65e73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:05.539578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 825/1645] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:05.547326 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e085-fea2-41c7-974a-7a0413a6cfdb None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.547735 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e085-fea2-41c7-974a-7a0413a6cfdb None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.548027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e085-fea2-41c7-974a-7a0413a6cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.551741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8cd61-8d59-472b-9770-56a519410777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.552362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8cd61-8d59-472b-9770-56a519410777 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.552651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8cd61-8d59-472b-9770-56a519410777 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.552933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8cd61-8d59-472b-9770-56a519410777 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.554151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8cd61-8d59-472b-9770-56a519410777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.574445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-cde5e085-fea2-41c7-974a-7a0413a6cfdb None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:05.576268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-cde5e085-fea2-41c7-974a-7a0413a6cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:05.580232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8cd61-8d59-472b-9770-56a519410777 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.583135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 826/1646] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:05.587713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e085-fea2-41c7-974a-7a0413a6cfdb None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.598127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e085-fea2-41c7-974a-7a0413a6cfdb None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.602747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 821/1647] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:05.606071 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bbc94-b692-4e99-9c41-bce1fb0b58e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.606520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bbc94-b692-4e99-9c41-bce1fb0b58e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.606675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8cd61-8d59-472b-9770-56a519410777 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.606839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bbc94-b692-4e99-9c41-bce1fb0b58e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.607125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bbc94-b692-4e99-9c41-bce1fb0b58e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.607895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bbc94-b692-4e99-9c41-bce1fb0b58e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:05.608194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bbc94-b692-4e99-9c41-bce1fb0b58e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.632068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8cd61-8d59-472b-9770-56a519410777 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.635858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bbc94-b692-4e99-9c41-bce1fb0b58e5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.636817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9669-ade4-4d78-b567-78d4f60c8211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.637520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9669-ade4-4d78-b567-78d4f60c8211 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.637911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9669-ade4-4d78-b567-78d4f60c8211 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.638408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9669-ade4-4d78-b567-78d4f60c8211 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.639282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed9669-ade4-4d78-b567-78d4f60c8211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.653773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 827/1648] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:12:05.654854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bbc94-b692-4e99-9c41-bce1fb0b58e5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.665012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bbc94-b692-4e99-9c41-bce1fb0b58e5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.666028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed9669-ade4-4d78-b567-78d4f60c8211 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.670186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ed0e5-674b-470b-b890-70439e582006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.670840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ed0e5-674b-470b-b890-70439e582006 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.671132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ed0e5-674b-470b-b890-70439e582006 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.671421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ed0e5-674b-470b-b890-70439e582006 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.672119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ed0e5-674b-470b-b890-70439e582006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.679533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 822/1649] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:05 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:05.682503 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9669-ade4-4d78-b567-78d4f60c8211 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.694771 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9669-ade4-4d78-b567-78d4f60c8211 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.699999 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c51cb-5242-437f-b317-b4c29776aa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.700145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ed0e5-674b-470b-b890-70439e582006 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.701283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c51cb-5242-437f-b317-b4c29776aa57 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.701751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c51cb-5242-437f-b317-b4c29776aa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.702781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c51cb-5242-437f-b317-b4c29776aa57 admin admin] PATH_INFO: `/v3/projects/2c758a8e60154c308bb8aa38120b7eb9/users/b1de76856c324e9ab5f4ce36ec12c114/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.727282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c51cb-5242-437f-b317-b4c29776aa57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c758a8e60154c308bb8aa38120b7eb9, user_id=b1de76856c324e9ab5f4ce36ec12c114, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.735330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 828/1650] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:05.736420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ed0e5-674b-470b-b890-70439e582006 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.754514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c51cb-5242-437f-b317-b4c29776aa57 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.770600 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 823/1651] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:05 2021] PUT /identity/v3/projects/2c758a8e60154c308bb8aa38120b7eb9/users/b1de76856c324e9ab5f4ce36ec12c114/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:05.823057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac420-a49b-4e4d-8ba0-9d30699d7ea9 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.823156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac420-a49b-4e4d-8ba0-9d30699d7ea9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.823448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac420-a49b-4e4d-8ba0-9d30699d7ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.826594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ed0e5-674b-470b-b890-70439e582006 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.861797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e54ac420-a49b-4e4d-8ba0-9d30699d7ea9 None None] MFA Rules not processed for user `b1de76856c324e9ab5f4ce36ec12c114`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:05.863490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e54ac420-a49b-4e4d-8ba0-9d30699d7ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:05.913847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b6b56-5dd6-4162-a2cf-2e7d67beec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.914457 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b6b56-5dd6-4162-a2cf-2e7d67beec8e admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.914892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b6b56-5dd6-4162-a2cf-2e7d67beec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.915075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b6b56-5dd6-4162-a2cf-2e7d67beec8e admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.915700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b6b56-5dd6-4162-a2cf-2e7d67beec8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.955009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b6b56-5dd6-4162-a2cf-2e7d67beec8e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:05.957480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 824/1652] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/auth/tokens => generated 3706 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:05.962298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ac420-a49b-4e4d-8ba0-9d30699d7ea9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:05.976055 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ac420-a49b-4e4d-8ba0-9d30699d7ea9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:05.981947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c1d8-2424-426b-b087-25fd261ff6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:05.982840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 829/1653] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:05.983112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c1d8-2424-426b-b087-25fd261ff6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:05.983462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c1d8-2424-426b-b087-25fd261ff6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:05.983699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c1d8-2424-426b-b087-25fd261ff6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:05.984364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c1d8-2424-426b-b087-25fd261ff6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:05.987858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b6b56-5dd6-4162-a2cf-2e7d67beec8e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.000086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b6b56-5dd6-4162-a2cf-2e7d67beec8e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.004896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf1634-16da-4a8f-82a3-f9084cf269b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.005760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf1634-16da-4a8f-82a3-f9084cf269b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.006300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf1634-16da-4a8f-82a3-f9084cf269b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.007317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf1634-16da-4a8f-82a3-f9084cf269b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.008567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf1634-16da-4a8f-82a3-f9084cf269b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.029948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c1d8-2424-426b-b087-25fd261ff6c2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.036331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf1634-16da-4a8f-82a3-f9084cf269b8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.047720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 830/1654] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:05 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:06.053500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf1634-16da-4a8f-82a3-f9084cf269b8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.066232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 825/1655] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:05 2021] POST /identity/v3/projects => generated 401 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:06.067196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c1d8-2424-426b-b087-25fd261ff6c2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.073608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf1634-16da-4a8f-82a3-f9084cf269b8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.158969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd70cd8-15f8-4a2f-bb6c-e2f592652067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.160272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70cd8-15f8-4a2f-bb6c-e2f592652067 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.160688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70cd8-15f8-4a2f-bb6c-e2f592652067 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.161050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd70cd8-15f8-4a2f-bb6c-e2f592652067 admin admin] PATH_INFO: `/v3/projects/90e498661fe94b189962756b78759b58/users/2a7d1fffdebc4de59fbf5a01508a0982/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.174543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c1d8-2424-426b-b087-25fd261ff6c2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.179960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80134e-f40c-4e90-b74d-453ee36f7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.180574 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80134e-f40c-4e90-b74d-453ee36f7ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.180869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80134e-f40c-4e90-b74d-453ee36f7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.181476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80134e-f40c-4e90-b74d-453ee36f7ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.182171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80134e-f40c-4e90-b74d-453ee36f7ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.184295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd70cd8-15f8-4a2f-bb6c-e2f592652067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e498661fe94b189962756b78759b58, user_id=2a7d1fffdebc4de59fbf5a01508a0982, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.211614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80134e-f40c-4e90-b74d-453ee36f7ea3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.218892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd70cd8-15f8-4a2f-bb6c-e2f592652067 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.234532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 831/1656] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:06 2021] PUT /identity/v3/projects/90e498661fe94b189962756b78759b58/users/2a7d1fffdebc4de59fbf5a01508a0982/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:06.238663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 826/1657] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:06 2021] POST /identity/v3/users => generated 307 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:06.241193 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd70cd8-15f8-4a2f-bb6c-e2f592652067 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.246608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb938fa-9eb6-4508-aa78-64cfa27e911e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.247083 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb938fa-9eb6-4508-aa78-64cfa27e911e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.247568 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb938fa-9eb6-4508-aa78-64cfa27e911e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.288871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-cdb938fa-9eb6-4508-aa78-64cfa27e911e None None] MFA Rules not processed for user `2a7d1fffdebc4de59fbf5a01508a0982`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:06.290211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cdb938fa-9eb6-4508-aa78-64cfa27e911e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:06.321026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd70cd8-15f8-4a2f-bb6c-e2f592652067 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.325319 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb64f0-3f19-40a2-ae13-cfbf683af087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.325959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb64f0-3f19-40a2-ae13-cfbf683af087 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.326381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb64f0-3f19-40a2-ae13-cfbf683af087 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.326713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb64f0-3f19-40a2-ae13-cfbf683af087 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.327486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb64f0-3f19-40a2-ae13-cfbf683af087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.353492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb64f0-3f19-40a2-ae13-cfbf683af087 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.365375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 832/1658] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:06.370005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb64f0-3f19-40a2-ae13-cfbf683af087 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.373629 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 827/1659] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:06 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:06.377969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb938fa-9eb6-4508-aa78-64cfa27e911e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.382510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb64f0-3f19-40a2-ae13-cfbf683af087 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.389274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb938fa-9eb6-4508-aa78-64cfa27e911e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.389798 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7420d-485f-42d8-b5b3-72236c49a2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.391234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7420d-485f-42d8-b5b3-72236c49a2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.391712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7420d-485f-42d8-b5b3-72236c49a2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.392140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7420d-485f-42d8-b5b3-72236c49a2d0 admin admin] PATH_INFO: `/v3/projects/30cd4ac4e0944ff58d1f73da07006724/users/31817d49dd704527a7a8345bc5ab148c/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.393708 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58744f4-2fd9-4c1e-97ee-5a849c08ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.394409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58744f4-2fd9-4c1e-97ee-5a849c08ba2d admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.394798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58744f4-2fd9-4c1e-97ee-5a849c08ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.395170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58744f4-2fd9-4c1e-97ee-5a849c08ba2d admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.395875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58744f4-2fd9-4c1e-97ee-5a849c08ba2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.419041 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7420d-485f-42d8-b5b3-72236c49a2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cd4ac4e0944ff58d1f73da07006724, user_id=31817d49dd704527a7a8345bc5ab148c, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.424275 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58744f4-2fd9-4c1e-97ee-5a849c08ba2d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.446172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7420d-485f-42d8-b5b3-72236c49a2d0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.454777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 828/1660] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:06 2021] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:06.459155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58744f4-2fd9-4c1e-97ee-5a849c08ba2d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.461494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 833/1661] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:06 2021] PUT /identity/v3/projects/30cd4ac4e0944ff58d1f73da07006724/users/31817d49dd704527a7a8345bc5ab148c/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:06.465177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7420d-485f-42d8-b5b3-72236c49a2d0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.555711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58744f4-2fd9-4c1e-97ee-5a849c08ba2d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.558729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7420d-485f-42d8-b5b3-72236c49a2d0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.564225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02976b08-f4a5-4d1f-be29-09ba103429c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.564948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02976b08-f4a5-4d1f-be29-09ba103429c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.565337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02976b08-f4a5-4d1f-be29-09ba103429c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.565798 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02976b08-f4a5-4d1f-be29-09ba103429c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.566592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02976b08-f4a5-4d1f-be29-09ba103429c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.567627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc321ca-3030-410e-a520-40f57ceb0495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.568244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc321ca-3030-410e-a520-40f57ceb0495 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.568542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc321ca-3030-410e-a520-40f57ceb0495 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.569497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc321ca-3030-410e-a520-40f57ceb0495 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.570207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc321ca-3030-410e-a520-40f57ceb0495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.596382 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02976b08-f4a5-4d1f-be29-09ba103429c7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.600783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc321ca-3030-410e-a520-40f57ceb0495 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.607835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 834/1662] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:06.611877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02976b08-f4a5-4d1f-be29-09ba103429c7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.625556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02976b08-f4a5-4d1f-be29-09ba103429c7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.633049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f4635-4224-4522-8e1b-24e0e0df0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.633938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f4635-4224-4522-8e1b-24e0e0df0b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.634234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f4635-4224-4522-8e1b-24e0e0df0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.634577 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f4635-4224-4522-8e1b-24e0e0df0b7a admin admin] PATH_INFO: `/v3/projects/30cd4ac4e0944ff58d1f73da07006724/users/31817d49dd704527a7a8345bc5ab148c/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.636585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 829/1663] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:06 2021] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:06.637023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f4635-4224-4522-8e1b-24e0e0df0b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cd4ac4e0944ff58d1f73da07006724, user_id=31817d49dd704527a7a8345bc5ab148c, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.637589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc321ca-3030-410e-a520-40f57ceb0495 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.648056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc321ca-3030-410e-a520-40f57ceb0495 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.655380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a75067-ffef-4282-a30f-7bd1b35564d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.656297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a75067-ffef-4282-a30f-7bd1b35564d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.656819 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a75067-ffef-4282-a30f-7bd1b35564d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.658805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a75067-ffef-4282-a30f-7bd1b35564d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.659758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a75067-ffef-4282-a30f-7bd1b35564d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.696222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a75067-ffef-4282-a30f-7bd1b35564d2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.700229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f4635-4224-4522-8e1b-24e0e0df0b7a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:06.708016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 830/1664] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:06.713768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a75067-ffef-4282-a30f-7bd1b35564d2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.728832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a75067-ffef-4282-a30f-7bd1b35564d2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.740342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 835/1665] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:06 2021] PUT /identity/v3/projects/30cd4ac4e0944ff58d1f73da07006724/users/31817d49dd704527a7a8345bc5ab148c/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:06.746328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f4635-4224-4522-8e1b-24e0e0df0b7a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:06.928023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de7c38-20b3-4546-96be-8aaa0943a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.930423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de7c38-20b3-4546-96be-8aaa0943a365 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.930849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de7c38-20b3-4546-96be-8aaa0943a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.932553 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de7c38-20b3-4546-96be-8aaa0943a365 admin admin] PATH_INFO: `/v3/projects/28727e1da30e4f25ab1c54dd550dbc67/users/416e978b5dc5463093b71d806217963b/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.952065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f4635-4224-4522-8e1b-24e0e0df0b7a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:06.957942 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf2747-6a58-4aa2-9a40-b80f420eb2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:06.958762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2747-6a58-4aa2-9a40-b80f420eb2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:06.959057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2747-6a58-4aa2-9a40-b80f420eb2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:06.960016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2747-6a58-4aa2-9a40-b80f420eb2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:06.961060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf2747-6a58-4aa2-9a40-b80f420eb2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.962422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de7c38-20b3-4546-96be-8aaa0943a365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28727e1da30e4f25ab1c54dd550dbc67, user_id=416e978b5dc5463093b71d806217963b, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:06.998745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf2747-6a58-4aa2-9a40-b80f420eb2a1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:07.031428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 836/1666] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:07.035447 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf2747-6a58-4aa2-9a40-b80f420eb2a1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:07.054890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf2747-6a58-4aa2-9a40-b80f420eb2a1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:07.064185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548ac60-84fe-4638-9e82-0c80c3a2d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:07.065434 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548ac60-84fe-4638-9e82-0c80c3a2d7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:07.065871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548ac60-84fe-4638-9e82-0c80c3a2d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:07.066428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548ac60-84fe-4638-9e82-0c80c3a2d7f5 admin admin] PATH_INFO: `/v3/projects/30cd4ac4e0944ff58d1f73da07006724/users/31817d49dd704527a7a8345bc5ab148c/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:07.068610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548ac60-84fe-4638-9e82-0c80c3a2d7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cd4ac4e0944ff58d1f73da07006724, user_id=31817d49dd704527a7a8345bc5ab148c, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:07.069659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de7c38-20b3-4546-96be-8aaa0943a365 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:07.101787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 831/1667] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:06 2021] PUT /identity/v3/projects/28727e1da30e4f25ab1c54dd550dbc67/users/416e978b5dc5463093b71d806217963b/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:07.106075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de7c38-20b3-4546-96be-8aaa0943a365 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:07.112264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548ac60-84fe-4638-9e82-0c80c3a2d7f5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:07.143503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 837/1668] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:07 2021] PUT /identity/v3/projects/30cd4ac4e0944ff58d1f73da07006724/users/31817d49dd704527a7a8345bc5ab148c/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:07.143503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548ac60-84fe-4638-9e82-0c80c3a2d7f5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:07.145344 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b548ac60-84fe-4638-9e82-0c80c3a2d7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:07.244251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de7c38-20b3-4546-96be-8aaa0943a365 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:07.317636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548ac60-84fe-4638-9e82-0c80c3a2d7f5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:07.327315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:07.328144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:07.328435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:07.328718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] PATH_INFO: `/v3/users/b3f48a9915a14ab6acee1f8a1e36968f` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:07.330364 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f48a9915a14ab6acee1f8a1e36968f)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:07.381088 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c754a70-33d2-4569-b416-bbc4ad2f3dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:07.382545 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754a70-33d2-4569-b416-bbc4ad2f3dbc admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:07.382885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754a70-33d2-4569-b416-bbc4ad2f3dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:07.383170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754a70-33d2-4569-b416-bbc4ad2f3dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:07.383935 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c754a70-33d2-4569-b416-bbc4ad2f3dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:07.390576 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:07.434984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c754a70-33d2-4569-b416-bbc4ad2f3dbc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:07.454761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 832/1669] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:07 2021] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:07.457607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ac58-77c5-489f-ab77-ed1d4419cd34 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:07.457978 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ac58-77c5-489f-ab77-ed1d4419cd34 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:07.458346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ac58-77c5-489f-ab77-ed1d4419cd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:07.512044 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7c71ac58-77c5-489f-ab77-ed1d4419cd34 None None] MFA Rules not processed for user `31817d49dd704527a7a8345bc5ab148c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:07.513293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7c71ac58-77c5-489f-ab77-ed1d4419cd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:07.515327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f48a9915a14ab6acee1f8a1e36968f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:07.543439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f48a9915a14ab6acee1f8a1e36968f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:07.547277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f48a9915a14ab6acee1f8a1e36968f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:07.566327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f48a9915a14ab6acee1f8a1e36968f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:07.581652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f48a9915a14ab6acee1f8a1e36968f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:07.595078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 838/1670] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:07 2021] DELETE /identity/v3/users/b3f48a9915a14ab6acee1f8a1e36968f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:07.597948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:07.603878 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:07.720732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 833/1671] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:07 2021] POST /identity/v3/auth/tokens => generated 3775 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:07.722500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec24e8-a743-4b5c-9cd0-4636abf05dcb None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:07.722768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec24e8-a743-4b5c-9cd0-4636abf05dcb None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:07.723055 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec24e8-a743-4b5c-9cd0-4636abf05dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:07.767832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-bdec24e8-a743-4b5c-9cd0-4636abf05dcb None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:07.769172 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-bdec24e8-a743-4b5c-9cd0-4636abf05dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:07.823455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d96099-d7d2-4387-b3c4-7e5db6c46abf admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:07.834896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45778ac-14fa-45f3-ae0c-57a05926e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:07.836974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45778ac-14fa-45f3-ae0c-57a05926e2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:07.837946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45778ac-14fa-45f3-ae0c-57a05926e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:07.838261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45778ac-14fa-45f3-ae0c-57a05926e2fc admin admin] PATH_INFO: `/v3/projects/28727e1da30e4f25ab1c54dd550dbc67/users/416e978b5dc5463093b71d806217963b/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:07.843212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45778ac-14fa-45f3-ae0c-57a05926e2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=28727e1da30e4f25ab1c54dd550dbc67, user_id=416e978b5dc5463093b71d806217963b, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:07.907369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45778ac-14fa-45f3-ae0c-57a05926e2fc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:07.931686 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 839/1672] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:07 2021] PUT /identity/v3/projects/28727e1da30e4f25ab1c54dd550dbc67/users/416e978b5dc5463093b71d806217963b/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:07.932984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5199-f9a6-4b04-88ed-1ca024668c1a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:07.933282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5199-f9a6-4b04-88ed-1ca024668c1a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:07.933573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5199-f9a6-4b04-88ed-1ca024668c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:07.937058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 834/1673] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:12:07 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:07.937919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec24e8-a743-4b5c-9cd0-4636abf05dcb None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:07.939601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-bdec24e8-a743-4b5c-9cd0-4636abf05dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:08.023922 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-dc2b5199-f9a6-4b04-88ed-1ca024668c1a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:08.029305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-dc2b5199-f9a6-4b04-88ed-1ca024668c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:08.062412 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec24e8-a743-4b5c-9cd0-4636abf05dcb None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:08.144243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb12c71-03d4-4cee-8fbc-0ad5d89bb1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:08.144998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb12c71-03d4-4cee-8fbc-0ad5d89bb1be service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:08.145294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb12c71-03d4-4cee-8fbc-0ad5d89bb1be service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:08.145581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb12c71-03d4-4cee-8fbc-0ad5d89bb1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:08.267266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 840/1674] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:08.268825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b5199-f9a6-4b04-88ed-1ca024668c1a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:08.291768 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b5199-f9a6-4b04-88ed-1ca024668c1a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:08.295926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb12c71-03d4-4cee-8fbc-0ad5d89bb1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:08.304206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dcab8-6d1c-4bc7-88b9-cd5ef79dc9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:08.305359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dcab8-6d1c-4bc7-88b9-cd5ef79dc9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:08.305711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dcab8-6d1c-4bc7-88b9-cd5ef79dc9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:08.305998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dcab8-6d1c-4bc7-88b9-cd5ef79dc9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:08.307451 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dcab8-6d1c-4bc7-88b9-cd5ef79dc9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:08.363373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb12c71-03d4-4cee-8fbc-0ad5d89bb1be service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:08.377403 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dcab8-6d1c-4bc7-88b9-cd5ef79dc9a3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:08.390127 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 835/1675] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:07 2021] GET /identity/v3/auth/tokens => generated 3775 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:08.404382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb12c71-03d4-4cee-8fbc-0ad5d89bb1be service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:08.411130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2fb12c71-03d4-4cee-8fbc-0ad5d89bb1be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:08.429633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 841/1676] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:08 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:08.434070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dcab8-6d1c-4bc7-88b9-cd5ef79dc9a3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:08.467420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dcab8-6d1c-4bc7-88b9-cd5ef79dc9a3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:08.483691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232398-5b4b-4919-a998-7b894e749e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:08.484310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232398-5b4b-4919-a998-7b894e749e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:08.485133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232398-5b4b-4919-a998-7b894e749e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:08.486873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232398-5b4b-4919-a998-7b894e749e19 admin admin] PATH_INFO: `/v3/projects/28727e1da30e4f25ab1c54dd550dbc67/users/416e978b5dc5463093b71d806217963b/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:08.490293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232398-5b4b-4919-a998-7b894e749e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28727e1da30e4f25ab1c54dd550dbc67, user_id=416e978b5dc5463093b71d806217963b, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:08.560574 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232398-5b4b-4919-a998-7b894e749e19 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:08.602658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 842/1677] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:08 2021] PUT /identity/v3/projects/28727e1da30e4f25ab1c54dd550dbc67/users/416e978b5dc5463093b71d806217963b/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:08.602658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232398-5b4b-4919-a998-7b894e749e19 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:08.604715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d3232398-5b4b-4919-a998-7b894e749e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:08.671419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb12c71-03d4-4cee-8fbc-0ad5d89bb1be service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:08.743345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232398-5b4b-4919-a998-7b894e749e19 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:08.751182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe6738-0218-4218-b05b-317849a5d104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:08.753419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe6738-0218-4218-b05b-317849a5d104 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:08.754057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe6738-0218-4218-b05b-317849a5d104 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:08.755561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe6738-0218-4218-b05b-317849a5d104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:08.756919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bedd1-fa70-438b-9fcc-898718535665 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:08.757472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bedd1-fa70-438b-9fcc-898718535665 service swift] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:08.757772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bedd1-fa70-438b-9fcc-898718535665 service swift] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:08.758063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bedd1-fa70-438b-9fcc-898718535665 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:08.843924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bedd1-fa70-438b-9fcc-898718535665 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:08.877323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bedd1-fa70-438b-9fcc-898718535665 service swift] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:08.898409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 836/1678] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:12:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:12:08.899725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5b95f-d44b-45d2-aaf7-9b6b43bd888a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:08.900024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5b95f-d44b-45d2-aaf7-9b6b43bd888a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:08.900310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5b95f-d44b-45d2-aaf7-9b6b43bd888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:08.931531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe6738-0218-4218-b05b-317849a5d104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:08.992179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe6738-0218-4218-b05b-317849a5d104 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:09.015123 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 843/1679] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:09.016198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe6738-0218-4218-b05b-317849a5d104 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:09.053513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5ac5b95f-d44b-45d2-aaf7-9b6b43bd888a None None] MFA Rules not processed for user `416e978b5dc5463093b71d806217963b`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:09.056145 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5ac5b95f-d44b-45d2-aaf7-9b6b43bd888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:09.157674 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe6738-0218-4218-b05b-317849a5d104 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:09.171926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:09.172632 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:09.173042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:09.173346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:09.176346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:09.268834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 837/1680] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:08 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:09.270354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f255f-6520-4fd1-b2f9-4b0d6ef03b60 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:09.270847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f255f-6520-4fd1-b2f9-4b0d6ef03b60 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:09.294173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f255f-6520-4fd1-b2f9-4b0d6ef03b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:09.349378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-805f255f-6520-4fd1-b2f9-4b0d6ef03b60 None None] MFA Rules not processed for user `dea5ec2125f0468baa1e15a429021e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:09.351355 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-805f255f-6520-4fd1-b2f9-4b0d6ef03b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:09.368950 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:09.375309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 838/1681] 10.222.0.79 () {58 vars in 1015 bytes} [Wed Oct 27 14:12:09 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:09.376182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f255f-6520-4fd1-b2f9-4b0d6ef03b60 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:09.377508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-805f255f-6520-4fd1-b2f9-4b0d6ef03b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:09.403827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f255f-6520-4fd1-b2f9-4b0d6ef03b60 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:09.415083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:09.426101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:09.426986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:09.427291 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:09.427577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] PATH_INFO: `/v3/users/b86f472c880143bda1e31ef5f010e736` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:09.430076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86f472c880143bda1e31ef5f010e736)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:09.455556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 844/1682] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:09 2021] GET /identity/v3/auth/tokens => generated 3706 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:09.456426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:09.458590 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:09.480941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fff5ec-fb31-4534-b97b-084064e33091 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:09.485911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:09.488071 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3da5-04e5-40bc-87e2-e5080da7695c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:09.489328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3da5-04e5-40bc-87e2-e5080da7695c service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:09.492003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3da5-04e5-40bc-87e2-e5080da7695c service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:09.493402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3da5-04e5-40bc-87e2-e5080da7695c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:09.515002 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b3da5-04e5-40bc-87e2-e5080da7695c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:09.572481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b3da5-04e5-40bc-87e2-e5080da7695c service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:09.601405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 845/1683] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:09 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:09.604367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86f472c880143bda1e31ef5f010e736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:09.618097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3da5-04e5-40bc-87e2-e5080da7695c service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:09.627309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-838b3da5-04e5-40bc-87e2-e5080da7695c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:09.645022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86f472c880143bda1e31ef5f010e736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:09.646888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86f472c880143bda1e31ef5f010e736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:09.667923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3da5-04e5-40bc-87e2-e5080da7695c service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:09.674961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86f472c880143bda1e31ef5f010e736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:09.675424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aab3d-455e-4ba4-a7fb-0f2b0809fefc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:09.676120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aab3d-455e-4ba4-a7fb-0f2b0809fefc service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:09.676415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aab3d-455e-4ba4-a7fb-0f2b0809fefc service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:09.676700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aab3d-455e-4ba4-a7fb-0f2b0809fefc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:09.692155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-73c47ea0-7d1d-434e-bb27-bfaa9445b713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86f472c880143bda1e31ef5f010e736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:09.707327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aab3d-455e-4ba4-a7fb-0f2b0809fefc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:09.713411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 839/1684] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:09 2021] DELETE /identity/v3/users/b86f472c880143bda1e31ef5f010e736 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:09.717633 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f01c-4a49-4e0a-add3-2ca13acbac9a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:09.717904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f01c-4a49-4e0a-add3-2ca13acbac9a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:09.718239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f01c-4a49-4e0a-add3-2ca13acbac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:09.764069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aab3d-455e-4ba4-a7fb-0f2b0809fefc service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:09.784551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 846/1685] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:09 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:09.795147 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c706f01c-4a49-4e0a-add3-2ca13acbac9a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:09.799063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c706f01c-4a49-4e0a-add3-2ca13acbac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:09.997299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 840/1686] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:10.030269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aab3d-455e-4ba4-a7fb-0f2b0809fefc service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:10.042313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aab3d-455e-4ba4-a7fb-0f2b0809fefc service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:10.259475 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661bd8f-6a26-48d6-88dd-4eb2d1c526bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:10.261834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661bd8f-6a26-48d6-88dd-4eb2d1c526bc service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:10.262180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661bd8f-6a26-48d6-88dd-4eb2d1c526bc service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:10.262506 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661bd8f-6a26-48d6-88dd-4eb2d1c526bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:10.290522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661bd8f-6a26-48d6-88dd-4eb2d1c526bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:10.370125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661bd8f-6a26-48d6-88dd-4eb2d1c526bc service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:10.395931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 847/1687] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:11.221242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f01c-4a49-4e0a-add3-2ca13acbac9a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:11.222700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c706f01c-4a49-4e0a-add3-2ca13acbac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:11.255254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f01c-4a49-4e0a-add3-2ca13acbac9a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:11.266873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:11.267939 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:11.268306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:11.268668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] PATH_INFO: `/v3/users/2a7d1fffdebc4de59fbf5a01508a0982` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:11.269868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7d1fffdebc4de59fbf5a01508a0982)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:11.322577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:11.433071 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7d1fffdebc4de59fbf5a01508a0982'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:11.454102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7d1fffdebc4de59fbf5a01508a0982'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:11.455181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7d1fffdebc4de59fbf5a01508a0982'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:11.466862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7d1fffdebc4de59fbf5a01508a0982'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:11.479108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7d1fffdebc4de59fbf5a01508a0982'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:11.488963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 841/1688] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:11 2021] DELETE /identity/v3/users/2a7d1fffdebc4de59fbf5a01508a0982 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:11.494886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97165b91-b61f-4682-9a4c-74a9cab0d7db None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:11.495861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97165b91-b61f-4682-9a4c-74a9cab0d7db None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:11.496323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97165b91-b61f-4682-9a4c-74a9cab0d7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:11.525805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-97165b91-b61f-4682-9a4c-74a9cab0d7db None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:11.527230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-97165b91-b61f-4682-9a4c-74a9cab0d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:11.679909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:11.680391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:11.714749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 848/1689] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:11.802370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97165b91-b61f-4682-9a4c-74a9cab0d7db None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:11.804741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-97165b91-b61f-4682-9a4c-74a9cab0d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:11.876206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b52a1-a884-4bea-bb0d-60dcd5cb4de3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:11.936217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:11.937012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:11.937303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:11.937591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] PATH_INFO: `/v3/projects/6a767bf41441494bbce465f04936246c` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:11.939305 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a767bf41441494bbce465f04936246c)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:11.995861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:11.997189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97165b91-b61f-4682-9a4c-74a9cab0d7db None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:12.019073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b18ca-2ead-4b8a-94f9-cac582f8e4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:12.019689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b18ca-2ead-4b8a-94f9-cac582f8e4ea service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:12.019985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b18ca-2ead-4b8a-94f9-cac582f8e4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:12.020274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b18ca-2ead-4b8a-94f9-cac582f8e4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:12.052114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b18ca-2ead-4b8a-94f9-cac582f8e4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:12.145290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a767bf41441494bbce465f04936246c', 'request_id': 'req-47d094c4-1cc0-4b04-afa8-babeb0b293c8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:12.156627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b18ca-2ead-4b8a-94f9-cac582f8e4ea service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:12.166844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a767bf41441494bbce465f04936246c', 'request_id': 'req-47d094c4-1cc0-4b04-afa8-babeb0b293c8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:12.179843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a767bf41441494bbce465f04936246c', 'request_id': 'req-47d094c4-1cc0-4b04-afa8-babeb0b293c8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:12.194197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] The token cache is being invalidate because project 6a767bf41441494bbce465f04936246c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:12.194197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:12.195059 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-47d094c4-1cc0-4b04-afa8-babeb0b293c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:12.202366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 842/1690] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:11 2021] DELETE /identity/v3/projects/6a767bf41441494bbce465f04936246c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:12.203445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 849/1691] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:12.203888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148ece3-81b7-4a86-8928-803b5fdff907 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:12.204184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148ece3-81b7-4a86-8928-803b5fdff907 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:12.204628 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148ece3-81b7-4a86-8928-803b5fdff907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:12.235909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b148ece3-81b7-4a86-8928-803b5fdff907 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:12.237546 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b148ece3-81b7-4a86-8928-803b5fdff907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:12.347616 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0cd15-2047-4b3c-a096-a3f0243a73cb None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:12.348013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 843/1692] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:12.348150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0cd15-2047-4b3c-a096-a3f0243a73cb None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:12.348464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0cd15-2047-4b3c-a096-a3f0243a73cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:12.390574 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-05a0cd15-2047-4b3c-a096-a3f0243a73cb None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:12.392049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-05a0cd15-2047-4b3c-a096-a3f0243a73cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:12.406208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 850/1693] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:12.417515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148ece3-81b7-4a86-8928-803b5fdff907 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:12.450518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148ece3-81b7-4a86-8928-803b5fdff907 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:12.465535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f572-c18f-444d-9ad0-b69337cc174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:12.468315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f572-c18f-444d-9ad0-b69337cc174f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:12.472725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f572-c18f-444d-9ad0-b69337cc174f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:12.479816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f572-c18f-444d-9ad0-b69337cc174f admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:12.481072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3f572-c18f-444d-9ad0-b69337cc174f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:12.482826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3f572-c18f-444d-9ad0-b69337cc174f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:12.568765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3f572-c18f-444d-9ad0-b69337cc174f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:12.617742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 844/1694] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:12.621496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0cd15-2047-4b3c-a096-a3f0243a73cb None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:12.635796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0cd15-2047-4b3c-a096-a3f0243a73cb None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:12.648425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc5d2d-afd4-44cf-932f-21f813c248c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:12.649285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc5d2d-afd4-44cf-932f-21f813c248c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:12.654827 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc5d2d-afd4-44cf-932f-21f813c248c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:12.655454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc5d2d-afd4-44cf-932f-21f813c248c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:12.656338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc5d2d-afd4-44cf-932f-21f813c248c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:12.732899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc5d2d-afd4-44cf-932f-21f813c248c7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:12.794037 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 851/1695] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:12 2021] POST /identity/v3/projects => generated 355 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:12.798926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f572-c18f-444d-9ad0-b69337cc174f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:12.821468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f572-c18f-444d-9ad0-b69337cc174f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:12.967994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bc33e-1a6e-450d-a283-ca7ccad7c694 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:12.968519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bc33e-1a6e-450d-a283-ca7ccad7c694 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:12.968951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bc33e-1a6e-450d-a283-ca7ccad7c694 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:12.971111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 852/1696] 10.222.0.36 () {54 vars in 921 bytes} [Wed Oct 27 14:12:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:12:12.979426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90d774-fea9-4ae9-8f4a-6550369714a2 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:12.979935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90d774-fea9-4ae9-8f4a-6550369714a2 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:12.980366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90d774-fea9-4ae9-8f4a-6550369714a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:13.025046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8a90d774-fea9-4ae9-8f4a-6550369714a2 None None] MFA Rules not processed for user `a523c35d222f464e9d4f78ae990e3a17`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:13.026665 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8a90d774-fea9-4ae9-8f4a-6550369714a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:13.126035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0df783-00d9-46a8-b23c-2c924dc2f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:13.126987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0df783-00d9-46a8-b23c-2c924dc2f045 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:13.128798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0df783-00d9-46a8-b23c-2c924dc2f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:13.129265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0df783-00d9-46a8-b23c-2c924dc2f045 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:13.130123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0df783-00d9-46a8-b23c-2c924dc2f045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:13.201643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 853/1697] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Oct 27 14:12:12 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:13.203392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90d774-fea9-4ae9-8f4a-6550369714a2 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:13.204690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8a90d774-fea9-4ae9-8f4a-6550369714a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:13.213693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0df783-00d9-46a8-b23c-2c924dc2f045 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:13.245482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90d774-fea9-4ae9-8f4a-6550369714a2 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:13.255829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:13.257726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:13.258220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:13.258982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] PATH_INFO: `/v3/projects/fd8e81f8654c461da6c9a3a41e80c7ba` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:13.262489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8e81f8654c461da6c9a3a41e80c7ba)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:13.285164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 845/1698] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:12 2021] POST /identity/v3/users => generated 278 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:13.290448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0df783-00d9-46a8-b23c-2c924dc2f045 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:13.294423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:13.297104 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-bf0df783-00d9-46a8-b23c-2c924dc2f045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:13.342961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0df783-00d9-46a8-b23c-2c924dc2f045 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:13.366722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2e8f8-2328-4fed-a837-8ee8c2b3baad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:13.367351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e8f8-2328-4fed-a837-8ee8c2b3baad service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:13.367642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e8f8-2328-4fed-a837-8ee8c2b3baad service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:13.367922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e8f8-2328-4fed-a837-8ee8c2b3baad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:13.395625 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2e8f8-2328-4fed-a837-8ee8c2b3baad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:13.398386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8e81f8654c461da6c9a3a41e80c7ba', 'request_id': 'req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:13.415237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8e81f8654c461da6c9a3a41e80c7ba', 'request_id': 'req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:13.432217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8e81f8654c461da6c9a3a41e80c7ba', 'request_id': 'req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:13.456913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] The token cache is being invalidate because project fd8e81f8654c461da6c9a3a41e80c7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:13.457165 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:13.457832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:13.460521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2e8f8-2328-4fed-a837-8ee8c2b3baad service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:13.474290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 854/1699] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:13 2021] DELETE /identity/v3/projects/fd8e81f8654c461da6c9a3a41e80c7ba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:13.474290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:13.474290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:13.507576 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 846/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:13 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:13.510513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790453-9a61-466d-9b3c-49a7ddfd611f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:13.510836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790453-9a61-466d-9b3c-49a7ddfd611f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:13.511121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790453-9a61-466d-9b3c-49a7ddfd611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:13.614309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ae790453-9a61-466d-9b3c-49a7ddfd611f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:13.621242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ae790453-9a61-466d-9b3c-49a7ddfd611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:13.623040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae237a-8a1c-460b-bcd8-2dcaf7204e82 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:13.629217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02485980-c1e3-4be7-bdc8-946826497396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:13.630262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02485980-c1e3-4be7-bdc8-946826497396 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:13.630728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02485980-c1e3-4be7-bdc8-946826497396 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:13.631330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02485980-c1e3-4be7-bdc8-946826497396 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:13.632438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02485980-c1e3-4be7-bdc8-946826497396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:13.652440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 847/1701] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:13.661241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94697110-b09d-4b66-998a-acfe80764987 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:13.661470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94697110-b09d-4b66-998a-acfe80764987 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:13.661738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94697110-b09d-4b66-998a-acfe80764987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:13.740861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02485980-c1e3-4be7-bdc8-946826497396 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:13.760969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-94697110-b09d-4b66-998a-acfe80764987 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:13.762280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-94697110-b09d-4b66-998a-acfe80764987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:13.771536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 855/1702] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:13 2021] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:13.776053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02485980-c1e3-4be7-bdc8-946826497396 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:13.797812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 848/1703] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:13.801743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02485980-c1e3-4be7-bdc8-946826497396 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:13.802483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94697110-b09d-4b66-998a-acfe80764987 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:13.818562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f39d5-ac1b-4fc5-b8dd-40222ae9cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:13.823186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f39d5-ac1b-4fc5-b8dd-40222ae9cc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:13.824785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f39d5-ac1b-4fc5-b8dd-40222ae9cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:13.825276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f39d5-ac1b-4fc5-b8dd-40222ae9cc88 admin admin] PATH_INFO: `/v3/projects/ece9676b085e4fad8059404b1dd4c9e7/users/81dca00d11db4388b7a82c00a989bbf7/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:13.833843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94697110-b09d-4b66-998a-acfe80764987 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:13.850243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47717d-53f4-4da5-b5b2-583b49844d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:13.853418 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47717d-53f4-4da5-b5b2-583b49844d98 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:13.853925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47717d-53f4-4da5-b5b2-583b49844d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:13.855140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47717d-53f4-4da5-b5b2-583b49844d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:13.856072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47717d-53f4-4da5-b5b2-583b49844d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:13.859545 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47717d-53f4-4da5-b5b2-583b49844d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:13.894026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f39d5-ac1b-4fc5-b8dd-40222ae9cc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece9676b085e4fad8059404b1dd4c9e7, user_id=81dca00d11db4388b7a82c00a989bbf7, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:13.926173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47717d-53f4-4da5-b5b2-583b49844d98 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:13.966524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 849/1704] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:12:13.968862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47717d-53f4-4da5-b5b2-583b49844d98 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:13.988927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f39d5-ac1b-4fc5-b8dd-40222ae9cc88 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:14.021690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 856/1705] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:13 2021] PUT /identity/v3/projects/ece9676b085e4fad8059404b1dd4c9e7/users/81dca00d11db4388b7a82c00a989bbf7/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:14.024391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f39d5-ac1b-4fc5-b8dd-40222ae9cc88 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:14.029560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47717d-53f4-4da5-b5b2-583b49844d98 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:14.044742 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-344f39d5-ac1b-4fc5-b8dd-40222ae9cc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:14.137251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252ec80-f346-4612-8ee6-6a22baa51232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:14.138350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252ec80-f346-4612-8ee6-6a22baa51232 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:14.138778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252ec80-f346-4612-8ee6-6a22baa51232 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:14.139182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252ec80-f346-4612-8ee6-6a22baa51232 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:14.139980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252ec80-f346-4612-8ee6-6a22baa51232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:14.190254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252ec80-f346-4612-8ee6-6a22baa51232 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:14.238735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 850/1706] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:13 2021] POST /identity/v3/projects => generated 367 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:14.241511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb347b6-7cb5-4fbd-a864-e9d35853c9d5 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:14.242160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb347b6-7cb5-4fbd-a864-e9d35853c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:14.242609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb347b6-7cb5-4fbd-a864-e9d35853c9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:14.252164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f39d5-ac1b-4fc5-b8dd-40222ae9cc88 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:14.298077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6cb347b6-7cb5-4fbd-a864-e9d35853c9d5 None None] MFA Rules not processed for user `81dca00d11db4388b7a82c00a989bbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:14.300684 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6cb347b6-7cb5-4fbd-a864-e9d35853c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:14.360669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:14.361573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:14.362211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:14.362545 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] PATH_INFO: `/v3/projects/90e498661fe94b189962756b78759b58` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:14.363994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e498661fe94b189962756b78759b58)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:14.415485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 851/1707] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:14 2021] POST /identity/v3/auth/tokens => generated 3662 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:14.416972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb347b6-7cb5-4fbd-a864-e9d35853c9d5 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:14.452970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb347b6-7cb5-4fbd-a864-e9d35853c9d5 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:14.454365 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:14.477393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679898a-23cd-4c80-8220-76b8f1c087d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:14.478903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679898a-23cd-4c80-8220-76b8f1c087d0 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:14.479655 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679898a-23cd-4c80-8220-76b8f1c087d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:14.480235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679898a-23cd-4c80-8220-76b8f1c087d0 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:14.481341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679898a-23cd-4c80-8220-76b8f1c087d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:14.592417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679898a-23cd-4c80-8220-76b8f1c087d0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:14.618929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e498661fe94b189962756b78759b58', 'request_id': 'req-995c0256-c3cb-4ee5-8f1b-35556340061e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:14.653788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 852/1708] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:14 2021] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:14.654596 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679898a-23cd-4c80-8220-76b8f1c087d0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:14.656622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e498661fe94b189962756b78759b58', 'request_id': 'req-995c0256-c3cb-4ee5-8f1b-35556340061e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:14.672645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e498661fe94b189962756b78759b58', 'request_id': 'req-995c0256-c3cb-4ee5-8f1b-35556340061e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:14.679889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679898a-23cd-4c80-8220-76b8f1c087d0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:14.700380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] The token cache is being invalidate because project 90e498661fe94b189962756b78759b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:14.703014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:14.704514 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:14.709605 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 857/1709] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:14 2021] DELETE /identity/v3/projects/90e498661fe94b189962756b78759b58 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:14.712118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:14.714251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:14.888200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c0256-c3cb-4ee5-8f1b-35556340061e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:14.895865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388305ae-3f27-4e99-a03f-5e520a551292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:14.897097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388305ae-3f27-4e99-a03f-5e520a551292 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:14.897771 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388305ae-3f27-4e99-a03f-5e520a551292 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:14.898204 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388305ae-3f27-4e99-a03f-5e520a551292 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:14.899670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388305ae-3f27-4e99-a03f-5e520a551292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:14.900213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae3349-af28-41b7-a80e-284b716454e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:14.900842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae3349-af28-41b7-a80e-284b716454e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:14.903334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae3349-af28-41b7-a80e-284b716454e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:14.903653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae3349-af28-41b7-a80e-284b716454e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:14.904373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae3349-af28-41b7-a80e-284b716454e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:14.964782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae3349-af28-41b7-a80e-284b716454e9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:14.966079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388305ae-3f27-4e99-a03f-5e520a551292 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:14.998061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 858/1710] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:14 2021] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:14.999009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae3349-af28-41b7-a80e-284b716454e9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:15.003670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-86ae3349-af28-41b7-a80e-284b716454e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:15.042460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae3349-af28-41b7-a80e-284b716454e9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:15.046048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 853/1711] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:14 2021] POST /identity/v3/projects => generated 355 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:15.047660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388305ae-3f27-4e99-a03f-5e520a551292 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:15.062450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:15.063314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:15.066252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:15.066554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] PATH_INFO: `/v3/users/416e978b5dc5463093b71d806217963b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:15.070542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] RBAC: Authorizing `identity:delete_user(user_id=416e978b5dc5463093b71d806217963b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:15.134647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:15.277939 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388305ae-3f27-4e99-a03f-5e520a551292 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:15.296433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7bc99-6958-4fb8-b469-6811771c57d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:15.299678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7bc99-6958-4fb8-b469-6811771c57d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:15.304236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7bc99-6958-4fb8-b469-6811771c57d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:15.305507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7bc99-6958-4fb8-b469-6811771c57d9 admin admin] PATH_INFO: `/v3/projects/1c8c058d6b0941e2aa771815625aadd1/users/835cfeae0318483fa4106423e91df736/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:15.330371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416e978b5dc5463093b71d806217963b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:15.358492 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7bc99-6958-4fb8-b469-6811771c57d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8c058d6b0941e2aa771815625aadd1, user_id=835cfeae0318483fa4106423e91df736, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:15.371329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416e978b5dc5463093b71d806217963b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:15.372815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416e978b5dc5463093b71d806217963b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:15.416891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7bc99-6958-4fb8-b469-6811771c57d9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:15.418129 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416e978b5dc5463093b71d806217963b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:15.449544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0204ce8d-ee66-4703-8164-5e80c08aa87b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416e978b5dc5463093b71d806217963b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:15.451664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 854/1712] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:15 2021] PUT /identity/v3/projects/1c8c058d6b0941e2aa771815625aadd1/users/835cfeae0318483fa4106423e91df736/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:15.454058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7bc99-6958-4fb8-b469-6811771c57d9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:15.461786 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0ce7bc99-6958-4fb8-b469-6811771c57d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:15.491429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 859/1713] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:14 2021] DELETE /identity/v3/users/416e978b5dc5463093b71d806217963b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:15.491604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ab21-3e10-474c-a89f-02ddebd8c424 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:15.492256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ab21-3e10-474c-a89f-02ddebd8c424 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:15.494334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ab21-3e10-474c-a89f-02ddebd8c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:15.633812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-4a61ab21-3e10-474c-a89f-02ddebd8c424 None None] MFA Rules not processed for user `835cfeae0318483fa4106423e91df736`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:15.635056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4a61ab21-3e10-474c-a89f-02ddebd8c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:15.679276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7bc99-6958-4fb8-b469-6811771c57d9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:15.882975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aa6ba-8d0e-4937-825e-c323d5ae8319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:15.883951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aa6ba-8d0e-4937-825e-c323d5ae8319 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:15.885274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aa6ba-8d0e-4937-825e-c323d5ae8319 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:15.885854 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aa6ba-8d0e-4937-825e-c323d5ae8319 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:15.889952 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aa6ba-8d0e-4937-825e-c323d5ae8319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:15.928833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 860/1714] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:15 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:15.930013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ab21-3e10-474c-a89f-02ddebd8c424 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:15.951502 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4a61ab21-3e10-474c-a89f-02ddebd8c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:15.986479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ab21-3e10-474c-a89f-02ddebd8c424 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:15.989086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aa6ba-8d0e-4937-825e-c323d5ae8319 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:16.008669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:16.009582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:16.009904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:16.010212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] PATH_INFO: `/v3/users/b1de76856c324e9ab5f4ce36ec12c114` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:16.012393 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1de76856c324e9ab5f4ce36ec12c114)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:16.057006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 855/1715] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:15 2021] POST /identity/v3/users => generated 284 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:16.057006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aa6ba-8d0e-4937-825e-c323d5ae8319 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:16.069447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a93aa6ba-8d0e-4937-825e-c323d5ae8319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:16.082415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:16.190190 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1de76856c324e9ab5f4ce36ec12c114'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:16.209499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aa6ba-8d0e-4937-825e-c323d5ae8319 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:16.215313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1de76856c324e9ab5f4ce36ec12c114'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:16.216333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1de76856c324e9ab5f4ce36ec12c114'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:16.220158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53782831-e5cb-4f41-9b2a-e3aa66fc113f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:16.220757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53782831-e5cb-4f41-9b2a-e3aa66fc113f service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:16.221052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53782831-e5cb-4f41-9b2a-e3aa66fc113f service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:16.221331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53782831-e5cb-4f41-9b2a-e3aa66fc113f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:16.229877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1de76856c324e9ab5f4ce36ec12c114'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:16.244601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1de76856c324e9ab5f4ce36ec12c114'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:16.246685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53782831-e5cb-4f41-9b2a-e3aa66fc113f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:16.257484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 861/1716] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:15 2021] DELETE /identity/v3/users/b1de76856c324e9ab5f4ce36ec12c114 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:16.259018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:16.260833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:16.324559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53782831-e5cb-4f41-9b2a-e3aa66fc113f service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:16.341255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 856/1717] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:16 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:16.342560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8ff90-bbe0-450f-95ab-679b47bbf597 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:16.342882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8ff90-bbe0-450f-95ab-679b47bbf597 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:16.343171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8ff90-bbe0-450f-95ab-679b47bbf597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:16.406709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-adf8ff90-bbe0-450f-95ab-679b47bbf597 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:16.413218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-adf8ff90-bbe0-450f-95ab-679b47bbf597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:16.433328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80947-ceb1-4c5f-9e96-52e17ddd3666 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:16.442821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e0fa7-a36c-4df0-bfc6-22730da05f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:16.443804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e0fa7-a36c-4df0-bfc6-22730da05f78 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:16.444290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e0fa7-a36c-4df0-bfc6-22730da05f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:16.444763 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e0fa7-a36c-4df0-bfc6-22730da05f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:16.445660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e0fa7-a36c-4df0-bfc6-22730da05f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:16.457094 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 857/1718] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:16.481192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8ff90-bbe0-450f-95ab-679b47bbf597 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:16.483548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-adf8ff90-bbe0-450f-95ab-679b47bbf597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:16.506003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e0fa7-a36c-4df0-bfc6-22730da05f78 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:16.539940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 862/1719] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:16 2021] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:16.550404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e0fa7-a36c-4df0-bfc6-22730da05f78 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:16.571027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e0fa7-a36c-4df0-bfc6-22730da05f78 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:16.580377 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197ab4c-81a5-4af3-825b-5d6be22a5412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:16.580377 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197ab4c-81a5-4af3-825b-5d6be22a5412 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:16.580377 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197ab4c-81a5-4af3-825b-5d6be22a5412 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:16.580377 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197ab4c-81a5-4af3-825b-5d6be22a5412 admin admin] PATH_INFO: `/v3/projects/4754f940d6a64acda03f553daa405e71/users/78f9fc2c6c6f4bc09a265d45bdab22a6/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:16.607077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197ab4c-81a5-4af3-825b-5d6be22a5412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4754f940d6a64acda03f553daa405e71, user_id=78f9fc2c6c6f4bc09a265d45bdab22a6, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:16.634677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8ff90-bbe0-450f-95ab-679b47bbf597 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:16.638736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dee74a-f497-40a8-9a5e-de8507aa6a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:16.639539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dee74a-f497-40a8-9a5e-de8507aa6a72 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:16.640020 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dee74a-f497-40a8-9a5e-de8507aa6a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:16.640570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dee74a-f497-40a8-9a5e-de8507aa6a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:16.653426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dee74a-f497-40a8-9a5e-de8507aa6a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:16.691116 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197ab4c-81a5-4af3-825b-5d6be22a5412 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:16.702951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dee74a-f497-40a8-9a5e-de8507aa6a72 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:16.731574 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 863/1720] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:16 2021] PUT /identity/v3/projects/4754f940d6a64acda03f553daa405e71/users/78f9fc2c6c6f4bc09a265d45bdab22a6/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:16.735120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 858/1721] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:16.735783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197ab4c-81a5-4af3-825b-5d6be22a5412 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:16.970661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197ab4c-81a5-4af3-825b-5d6be22a5412 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:16.994823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ca54d-96f8-40ca-98ff-a4fce48d3969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:16.996388 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca54d-96f8-40ca-98ff-a4fce48d3969 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:16.998562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca54d-96f8-40ca-98ff-a4fce48d3969 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:16.999257 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca54d-96f8-40ca-98ff-a4fce48d3969 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:17.000330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ca54d-96f8-40ca-98ff-a4fce48d3969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:17.038045 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ca54d-96f8-40ca-98ff-a4fce48d3969 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:17.057779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 864/1722] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:16 2021] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:17.062198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dee74a-f497-40a8-9a5e-de8507aa6a72 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:17.075473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dee74a-f497-40a8-9a5e-de8507aa6a72 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:17.094925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c944b9-4c80-4e90-a296-ee6fe4fffdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:17.097497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c944b9-4c80-4e90-a296-ee6fe4fffdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:17.097792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c944b9-4c80-4e90-a296-ee6fe4fffdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:17.102976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c944b9-4c80-4e90-a296-ee6fe4fffdd3 admin admin] PATH_INFO: `/v3/projects/4754f940d6a64acda03f553daa405e71/users/78f9fc2c6c6f4bc09a265d45bdab22a6/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:17.108617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c944b9-4c80-4e90-a296-ee6fe4fffdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4754f940d6a64acda03f553daa405e71, user_id=78f9fc2c6c6f4bc09a265d45bdab22a6, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:17.215471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c944b9-4c80-4e90-a296-ee6fe4fffdd3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:17.252903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 859/1723] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:17 2021] PUT /identity/v3/projects/4754f940d6a64acda03f553daa405e71/users/78f9fc2c6c6f4bc09a265d45bdab22a6/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:17.257800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ca54d-96f8-40ca-98ff-a4fce48d3969 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:17.275255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ca54d-96f8-40ca-98ff-a4fce48d3969 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:17.456210 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b10d36-c94d-4d98-bd07-ccb8e2afbd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:17.460007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b10d36-c94d-4d98-bd07-ccb8e2afbd08 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:17.460411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b10d36-c94d-4d98-bd07-ccb8e2afbd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:17.460720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b10d36-c94d-4d98-bd07-ccb8e2afbd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:17.461451 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b10d36-c94d-4d98-bd07-ccb8e2afbd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:17.519856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b10d36-c94d-4d98-bd07-ccb8e2afbd08 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:17.558891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 865/1724] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:17 2021] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:17.560072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c944b9-4c80-4e90-a296-ee6fe4fffdd3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:17.572653 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c944b9-4c80-4e90-a296-ee6fe4fffdd3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:17.585840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b050755-1b53-4d6c-84b0-0a9770bb41fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:17.588133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050755-1b53-4d6c-84b0-0a9770bb41fb admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:17.588356 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050755-1b53-4d6c-84b0-0a9770bb41fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:17.588659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050755-1b53-4d6c-84b0-0a9770bb41fb admin admin] PATH_INFO: `/v3/projects/4754f940d6a64acda03f553daa405e71/users/78f9fc2c6c6f4bc09a265d45bdab22a6/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:17.594331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b050755-1b53-4d6c-84b0-0a9770bb41fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4754f940d6a64acda03f553daa405e71, user_id=78f9fc2c6c6f4bc09a265d45bdab22a6, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:17.677375 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b050755-1b53-4d6c-84b0-0a9770bb41fb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:17.712410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 860/1725] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:17 2021] PUT /identity/v3/projects/4754f940d6a64acda03f553daa405e71/users/78f9fc2c6c6f4bc09a265d45bdab22a6/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:17.771303 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eb372-ea18-4971-8814-9ac667709f8d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:17.771738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eb372-ea18-4971-8814-9ac667709f8d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:17.772127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eb372-ea18-4971-8814-9ac667709f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:17.854179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-032eb372-ea18-4971-8814-9ac667709f8d None None] MFA Rules not processed for user `78f9fc2c6c6f4bc09a265d45bdab22a6`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:17.855623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-032eb372-ea18-4971-8814-9ac667709f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:17.907726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b050755-1b53-4d6c-84b0-0a9770bb41fb admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:17.909309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0b050755-1b53-4d6c-84b0-0a9770bb41fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:18.080907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b050755-1b53-4d6c-84b0-0a9770bb41fb admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:18.096750 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:18.097688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:18.097930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:18.098222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] PATH_INFO: `/v3/projects/2c758a8e60154c308bb8aa38120b7eb9` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:18.099463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c758a8e60154c308bb8aa38120b7eb9)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:18.105346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 866/1726] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:17 2021] POST /identity/v3/auth/tokens => generated 3729 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:18.121622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eb372-ea18-4971-8814-9ac667709f8d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:18.123418 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-032eb372-ea18-4971-8814-9ac667709f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:18.161290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:18.247328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c758a8e60154c308bb8aa38120b7eb9', 'request_id': 'req-6d402dd9-2a61-430c-a958-930175018613'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.283313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032eb372-ea18-4971-8814-9ac667709f8d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:18.284710 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c758a8e60154c308bb8aa38120b7eb9', 'request_id': 'req-6d402dd9-2a61-430c-a958-930175018613'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.296870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c758a8e60154c308bb8aa38120b7eb9', 'request_id': 'req-6d402dd9-2a61-430c-a958-930175018613'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.322866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] The token cache is being invalidate because project 2c758a8e60154c308bb8aa38120b7eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:18.323225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.323968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.325539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 861/1727] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:17 2021] DELETE /identity/v3/projects/2c758a8e60154c308bb8aa38120b7eb9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:18.330370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:18.335165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:18.414858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:18.415666 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:18.415965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:18.416285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:18.418007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:18.541374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402dd9-2a61-430c-a958-930175018613 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:18.553347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:18.554510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:18.554905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:18.555452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] PATH_INFO: `/v3/users/31817d49dd704527a7a8345bc5ab148c` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:18.557130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31817d49dd704527a7a8345bc5ab148c)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:18.576939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:18.621900 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:18.650240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:18.662605 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 867/1728] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:18 2021] GET /identity/v3/auth/tokens => generated 3729 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:18.737713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31817d49dd704527a7a8345bc5ab148c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.774302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:18.775671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:18.778231 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31817d49dd704527a7a8345bc5ab148c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.780122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31817d49dd704527a7a8345bc5ab148c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.802154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31817d49dd704527a7a8345bc5ab148c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.809414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a10c5d-7cb2-4e6c-a89b-5ce36e07f610 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:18.820706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31817d49dd704527a7a8345bc5ab148c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:18.827856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:18.832637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:18.832637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:18.832873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] PATH_INFO: `/v3/projects/28727e1da30e4f25ab1c54dd550dbc67` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:18.835647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 862/1729] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:18 2021] DELETE /identity/v3/users/31817d49dd704527a7a8345bc5ab148c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:18.842283 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28727e1da30e4f25ab1c54dd550dbc67)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:18.907638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:18.909036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:18.972936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:19.183807 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28727e1da30e4f25ab1c54dd550dbc67', 'request_id': 'req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:19.213347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a35c5-82f0-4d37-8c53-7f0378d814d0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:19.273168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28727e1da30e4f25ab1c54dd550dbc67', 'request_id': 'req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:19.297111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28727e1da30e4f25ab1c54dd550dbc67', 'request_id': 'req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:19.355537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] The token cache is being invalidate because project 28727e1da30e4f25ab1c54dd550dbc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:19.356135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:19.357159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-83d9c47f-7a24-4a15-9c1f-12e6d7f6af46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:19.359666 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 868/1730] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:18 2021] DELETE /identity/v3/projects/28727e1da30e4f25ab1c54dd550dbc67 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:19.366544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f0c2-6f8e-4fd7-acc5-e6a72c22217f None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:19.367594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f0c2-6f8e-4fd7-acc5-e6a72c22217f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:19.368143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f0c2-6f8e-4fd7-acc5-e6a72c22217f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:19.431744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295e19a-47fa-421c-8c38-1399ee454fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:19.432171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295e19a-47fa-421c-8c38-1399ee454fcf service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:19.432458 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295e19a-47fa-421c-8c38-1399ee454fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:19.432913 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295e19a-47fa-421c-8c38-1399ee454fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:19.437440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2295e19a-47fa-421c-8c38-1399ee454fcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:19.449732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2a74f0c2-6f8e-4fd7-acc5-e6a72c22217f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:19.452555 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2a74f0c2-6f8e-4fd7-acc5-e6a72c22217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:19.609193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295e19a-47fa-421c-8c38-1399ee454fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:19.670583 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295e19a-47fa-421c-8c38-1399ee454fcf service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:19.692885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 863/1731] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:18 2021] GET /identity/v3/auth/tokens => generated 3662 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:19.708077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 869/1732] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:19.710675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d87df-42fa-4db4-8374-495be02f41ca None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:19.710939 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d87df-42fa-4db4-8374-495be02f41ca None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:19.711432 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d87df-42fa-4db4-8374-495be02f41ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:19.769322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c14d87df-42fa-4db4-8374-495be02f41ca None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:19.772097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c14d87df-42fa-4db4-8374-495be02f41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:19.784190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 864/1733] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:19.789233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74f0c2-6f8e-4fd7-acc5-e6a72c22217f None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:19.817733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74f0c2-6f8e-4fd7-acc5-e6a72c22217f None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:19.832408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e405a-05dc-4d7a-85c5-cf4b681a8b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:19.835690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e405a-05dc-4d7a-85c5-cf4b681a8b62 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:19.837234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e405a-05dc-4d7a-85c5-cf4b681a8b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:19.837996 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e405a-05dc-4d7a-85c5-cf4b681a8b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:19.841663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e405a-05dc-4d7a-85c5-cf4b681a8b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:19.842135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e405a-05dc-4d7a-85c5-cf4b681a8b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:19.901411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d87df-42fa-4db4-8374-495be02f41ca None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:19.903052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c14d87df-42fa-4db4-8374-495be02f41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:19.925419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d87df-42fa-4db4-8374-495be02f41ca None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:19.944573 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:19.949407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e405a-05dc-4d7a-85c5-cf4b681a8b62 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:19.949528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:19.954699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:19.958877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] PATH_INFO: `/v3/projects/30cd4ac4e0944ff58d1f73da07006724` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:19.960983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cd4ac4e0944ff58d1f73da07006724)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:20.005323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 870/1734] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:12:20.011682 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e405a-05dc-4d7a-85c5-cf4b681a8b62 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:20.043022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e405a-05dc-4d7a-85c5-cf4b681a8b62 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:20.059545 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3bfe4-f145-42e0-a52b-ab66162414b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:20.063064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3bfe4-f145-42e0-a52b-ab66162414b7 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.064926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3bfe4-f145-42e0-a52b-ab66162414b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.071413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:20.073249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3bfe4-f145-42e0-a52b-ab66162414b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.073998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3bfe4-f145-42e0-a52b-ab66162414b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:20.196487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3bfe4-f145-42e0-a52b-ab66162414b7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:20.265945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cd4ac4e0944ff58d1f73da07006724', 'request_id': 'req-ec777df2-2698-4474-9d42-f472ea40ca33'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:20.295710 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cd4ac4e0944ff58d1f73da07006724', 'request_id': 'req-ec777df2-2698-4474-9d42-f472ea40ca33'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:20.313323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cd4ac4e0944ff58d1f73da07006724', 'request_id': 'req-ec777df2-2698-4474-9d42-f472ea40ca33'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:20.315716 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 871/1735] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:20 2021] POST /identity/v3/projects => generated 363 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:20.319472 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc86a-1aa2-42be-b0e1-23fe86ea1b65 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.320167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc86a-1aa2-42be-b0e1-23fe86ea1b65 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.320476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc86a-1aa2-42be-b0e1-23fe86ea1b65 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.328532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 872/1736] 10.222.0.36 () {54 vars in 921 bytes} [Wed Oct 27 14:12:20 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:12:20.329419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc86a-1aa2-42be-b0e1-23fe86ea1b65 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:20.339879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] The token cache is being invalidate because project 30cd4ac4e0944ff58d1f73da07006724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:20.340363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:20.342054 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ec777df2-2698-4474-9d42-f472ea40ca33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:20.347774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 865/1737] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:19 2021] DELETE /identity/v3/projects/30cd4ac4e0944ff58d1f73da07006724 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:20.357152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223128d8-e2d8-4a6c-ac64-57b3bf77ccf5 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.357798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223128d8-e2d8-4a6c-ac64-57b3bf77ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.358327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223128d8-e2d8-4a6c-ac64-57b3bf77ccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.401310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-223128d8-e2d8-4a6c-ac64-57b3bf77ccf5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:20.405570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-223128d8-e2d8-4a6c-ac64-57b3bf77ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:20.504976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc86a-1aa2-42be-b0e1-23fe86ea1b65 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:20.511298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e863401-cf4f-44fc-9693-0b6d0f0666e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:20.512527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e863401-cf4f-44fc-9693-0b6d0f0666e4 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.513166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e863401-cf4f-44fc-9693-0b6d0f0666e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.513640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e863401-cf4f-44fc-9693-0b6d0f0666e4 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.514566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e863401-cf4f-44fc-9693-0b6d0f0666e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:20.549406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e863401-cf4f-44fc-9693-0b6d0f0666e4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:20.568366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 866/1738] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:20.568366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9f511-30aa-4083-ade1-8fd34718ea25 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.568366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9f511-30aa-4083-ade1-8fd34718ea25 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.568366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9f511-30aa-4083-ade1-8fd34718ea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.592572 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 873/1739] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:20 2021] POST /identity/v3/users => generated 282 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:20.594161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178d5c8-5b3a-4384-b2c7-6d4619d3733b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.594521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178d5c8-5b3a-4384-b2c7-6d4619d3733b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.597601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178d5c8-5b3a-4384-b2c7-6d4619d3733b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.651144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-f7a9f511-30aa-4083-ade1-8fd34718ea25 None None] MFA Rules not processed for user `a523c35d222f464e9d4f78ae990e3a17`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:20.656332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-f7a9f511-30aa-4083-ade1-8fd34718ea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:20.659353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0178d5c8-5b3a-4384-b2c7-6d4619d3733b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:20.660677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0178d5c8-5b3a-4384-b2c7-6d4619d3733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:20.684063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 874/1740] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:20.684063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178d5c8-5b3a-4384-b2c7-6d4619d3733b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:20.684063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0178d5c8-5b3a-4384-b2c7-6d4619d3733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:20.711230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178d5c8-5b3a-4384-b2c7-6d4619d3733b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:20.716385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21fd61-252a-4d78-862d-bb5b4b73fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:20.717005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21fd61-252a-4d78-862d-bb5b4b73fdda admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.717296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21fd61-252a-4d78-862d-bb5b4b73fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.717580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21fd61-252a-4d78-862d-bb5b4b73fdda admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.718381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21fd61-252a-4d78-862d-bb5b4b73fdda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:20.776449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21fd61-252a-4d78-862d-bb5b4b73fdda admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:20.810971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 875/1741] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:20 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:20.811968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21fd61-252a-4d78-862d-bb5b4b73fdda admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:20.835759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21fd61-252a-4d78-862d-bb5b4b73fdda admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:20.851178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a47b7-3aed-435e-a957-28de997eaca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:20.851975 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a47b7-3aed-435e-a957-28de997eaca9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.852389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a47b7-3aed-435e-a957-28de997eaca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.852623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a47b7-3aed-435e-a957-28de997eaca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.853333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a47b7-3aed-435e-a957-28de997eaca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:20.853642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a47b7-3aed-435e-a957-28de997eaca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:20.891986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 867/1742] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Oct 27 14:12:20 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:20.892986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9f511-30aa-4083-ade1-8fd34718ea25 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:20.917047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a47b7-3aed-435e-a957-28de997eaca9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:20.925307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9f511-30aa-4083-ade1-8fd34718ea25 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:20.931411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e2bb0-282a-4aa5-b2eb-f52dd40fe52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:20.932273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e2bb0-282a-4aa5-b2eb-f52dd40fe52e admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.932557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e2bb0-282a-4aa5-b2eb-f52dd40fe52e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.932834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e2bb0-282a-4aa5-b2eb-f52dd40fe52e admin admin] PATH_INFO: `/v3/projects/c25ef4d6e28147b8ab2d9ada03cb2d3b/users/ce2909e8033e4f19a4c8679fb2916a21/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.935204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 876/1743] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:20.939315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a47b7-3aed-435e-a957-28de997eaca9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:20.951343 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a47b7-3aed-435e-a957-28de997eaca9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:20.964298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d5d3-fb78-40bd-b853-0d5df253eb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:20.965308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d5d3-fb78-40bd-b853-0d5df253eb7f admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:20.965782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d5d3-fb78-40bd-b853-0d5df253eb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:20.966200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d5d3-fb78-40bd-b853-0d5df253eb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:20.968814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62d5d3-fb78-40bd-b853-0d5df253eb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:21.008918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e2bb0-282a-4aa5-b2eb-f52dd40fe52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25ef4d6e28147b8ab2d9ada03cb2d3b, user_id=ce2909e8033e4f19a4c8679fb2916a21, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:21.051215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62d5d3-fb78-40bd-b853-0d5df253eb7f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:21.117720 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e2bb0-282a-4aa5-b2eb-f52dd40fe52e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:21.128809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 877/1744] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:20 2021] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:21.129984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d5d3-fb78-40bd-b853-0d5df253eb7f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:21.155280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 868/1745] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:20 2021] PUT /identity/v3/projects/c25ef4d6e28147b8ab2d9ada03cb2d3b/users/ce2909e8033e4f19a4c8679fb2916a21/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:21.166988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8e99-1839-490b-a3c4-56414ff55bbd None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:21.167435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8e99-1839-490b-a3c4-56414ff55bbd None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:21.167854 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8e99-1839-490b-a3c4-56414ff55bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:21.270380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ac8f8e99-1839-490b-a3c4-56414ff55bbd None None] MFA Rules not processed for user `ce2909e8033e4f19a4c8679fb2916a21`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:21.272239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ac8f8e99-1839-490b-a3c4-56414ff55bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:21.302114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d5d3-fb78-40bd-b853-0d5df253eb7f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:21.479669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 869/1746] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:21 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:21.480873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8e99-1839-490b-a3c4-56414ff55bbd None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:21.483039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ac8f8e99-1839-490b-a3c4-56414ff55bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:21.497844 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8034-2c4e-4e6c-be42-0151039ffc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:21.498467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8034-2c4e-4e6c-be42-0151039ffc94 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:21.498802 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8034-2c4e-4e6c-be42-0151039ffc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:21.499093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8034-2c4e-4e6c-be42-0151039ffc94 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:21.499736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a8034-2c4e-4e6c-be42-0151039ffc94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:21.552733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a8034-2c4e-4e6c-be42-0151039ffc94 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:21.586127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 878/1747] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:21 2021] POST /identity/v3/users => generated 290 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:21.586127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8034-2c4e-4e6c-be42-0151039ffc94 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:21.603117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8034-2c4e-4e6c-be42-0151039ffc94 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:21.609165 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a03a4-a320-4758-a810-b407b22e9cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:21.609787 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a03a4-a320-4758-a810-b407b22e9cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:21.610103 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a03a4-a320-4758-a810-b407b22e9cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:21.610365 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a03a4-a320-4758-a810-b407b22e9cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:21.611065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a03a4-a320-4758-a810-b407b22e9cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:21.663741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a03a4-a320-4758-a810-b407b22e9cd5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:21.701686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8e99-1839-490b-a3c4-56414ff55bbd None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:21.707162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff0dd0-0ca9-46c2-a938-7391bf592b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:21.707756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff0dd0-0ca9-46c2-a938-7391bf592b59 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:21.708271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff0dd0-0ca9-46c2-a938-7391bf592b59 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:21.708987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff0dd0-0ca9-46c2-a938-7391bf592b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:21.728000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff0dd0-0ca9-46c2-a938-7391bf592b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:21.751703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 879/1748] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:21 2021] POST /identity/v3/projects => generated 363 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:21.754784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a03a4-a320-4758-a810-b407b22e9cd5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:21.763302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff0dd0-0ca9-46c2-a938-7391bf592b59 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:21.784510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 870/1749] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:21 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:21.786759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff0dd0-0ca9-46c2-a938-7391bf592b59 service nova] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:21.802884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff0dd0-0ca9-46c2-a938-7391bf592b59 service nova] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:21.872503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a03a4-a320-4758-a810-b407b22e9cd5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:21.878513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2840f-f98b-4cd7-beba-1758627a19c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:21.879310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2840f-f98b-4cd7-beba-1758627a19c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:21.879654 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2840f-f98b-4cd7-beba-1758627a19c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:21.879887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2840f-f98b-4cd7-beba-1758627a19c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:21.881279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2840f-f98b-4cd7-beba-1758627a19c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:21.897422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc98fbd-22df-4762-8022-d6f070378910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:21.898379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc98fbd-22df-4762-8022-d6f070378910 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:21.898830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc98fbd-22df-4762-8022-d6f070378910 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:21.899329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc98fbd-22df-4762-8022-d6f070378910 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:21.900162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc98fbd-22df-4762-8022-d6f070378910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:21.916739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2840f-f98b-4cd7-beba-1758627a19c2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:21.932707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 880/1750] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:21 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:21.933633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2840f-f98b-4cd7-beba-1758627a19c2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:21.937387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc98fbd-22df-4762-8022-d6f070378910 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:21.945496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2840f-f98b-4cd7-beba-1758627a19c2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:21.951622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629e5f-327e-4f48-bb2f-de25cd8ba026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:21.953435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629e5f-327e-4f48-bb2f-de25cd8ba026 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:21.953744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629e5f-327e-4f48-bb2f-de25cd8ba026 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:21.954674 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629e5f-327e-4f48-bb2f-de25cd8ba026 admin admin] PATH_INFO: `/v3/projects/3b0c239f878f491b955f083b1320dcd3/users/0600b670b0b04c0496bcaa65ce876517/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:21.966053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 871/1751] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:21 2021] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:21.972131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc98fbd-22df-4762-8022-d6f070378910 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:21.979489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629e5f-327e-4f48-bb2f-de25cd8ba026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0c239f878f491b955f083b1320dcd3, user_id=0600b670b0b04c0496bcaa65ce876517, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:21.985206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc98fbd-22df-4762-8022-d6f070378910 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:21.990035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10938c7c-20d0-459a-b750-6f8db577bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:21.990954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10938c7c-20d0-459a-b750-6f8db577bc72 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:21.991370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10938c7c-20d0-459a-b750-6f8db577bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:21.991770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10938c7c-20d0-459a-b750-6f8db577bc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:21.992756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10938c7c-20d0-459a-b750-6f8db577bc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:22.012852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629e5f-327e-4f48-bb2f-de25cd8ba026 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:22.027918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10938c7c-20d0-459a-b750-6f8db577bc72 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:22.032000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 881/1752] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:21 2021] PUT /identity/v3/projects/3b0c239f878f491b955f083b1320dcd3/users/0600b670b0b04c0496bcaa65ce876517/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:22.046125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e76c2-7710-4bb6-a410-7bd3ef6da155 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:22.047943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e76c2-7710-4bb6-a410-7bd3ef6da155 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:22.049658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e76c2-7710-4bb6-a410-7bd3ef6da155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:22.062323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 872/1753] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:21 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:22.063880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10938c7c-20d0-459a-b750-6f8db577bc72 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:22.088229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10938c7c-20d0-459a-b750-6f8db577bc72 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:22.110487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-184e76c2-7710-4bb6-a410-7bd3ef6da155 None None] MFA Rules not processed for user `0600b670b0b04c0496bcaa65ce876517`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:22.111802 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-184e76c2-7710-4bb6-a410-7bd3ef6da155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:22.246308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddd15e-fb88-4fb9-b4d2-92e48619e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:22.247292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddd15e-fb88-4fb9-b4d2-92e48619e92f admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:22.247687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddd15e-fb88-4fb9-b4d2-92e48619e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:22.248215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddd15e-fb88-4fb9-b4d2-92e48619e92f admin admin] PATH_INFO: `/v3/projects/d5a9616987af499b8ef9fcdb1a513eff/users/1ad97924e7564fed8f425147b1bbdb35/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:22.262717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 882/1754] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:22 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:22.265775 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e76c2-7710-4bb6-a410-7bd3ef6da155 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:22.276916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e76c2-7710-4bb6-a410-7bd3ef6da155 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:22.281635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddd15e-fb88-4fb9-b4d2-92e48619e92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a9616987af499b8ef9fcdb1a513eff, user_id=1ad97924e7564fed8f425147b1bbdb35, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:22.281761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58fb99-784d-40e9-b59e-2f474ebf0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:22.283079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58fb99-784d-40e9-b59e-2f474ebf0dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:22.283079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58fb99-784d-40e9-b59e-2f474ebf0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:22.283546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58fb99-784d-40e9-b59e-2f474ebf0dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:22.284316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58fb99-784d-40e9-b59e-2f474ebf0dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:22.312709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58fb99-784d-40e9-b59e-2f474ebf0dd3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:22.322843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddd15e-fb88-4fb9-b4d2-92e48619e92f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:22.355680 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 883/1755] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:22 2021] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:22.357345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 873/1756] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:22 2021] PUT /identity/v3/projects/d5a9616987af499b8ef9fcdb1a513eff/users/1ad97924e7564fed8f425147b1bbdb35/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:22.357463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58fb99-784d-40e9-b59e-2f474ebf0dd3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:22.361153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddd15e-fb88-4fb9-b4d2-92e48619e92f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:22.587426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58fb99-784d-40e9-b59e-2f474ebf0dd3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:22.598746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd988fa-5d6d-4ddf-a428-8ec830fef26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:22.599909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd988fa-5d6d-4ddf-a428-8ec830fef26e admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:22.600268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd988fa-5d6d-4ddf-a428-8ec830fef26e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:22.600787 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd988fa-5d6d-4ddf-a428-8ec830fef26e admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:22.601534 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd988fa-5d6d-4ddf-a428-8ec830fef26e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:22.662966 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd988fa-5d6d-4ddf-a428-8ec830fef26e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:22.708199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 884/1757] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:22 2021] POST /identity/v3/users => generated 290 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:22.712065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd988fa-5d6d-4ddf-a428-8ec830fef26e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:22.737320 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd988fa-5d6d-4ddf-a428-8ec830fef26e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:22.759283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddd15e-fb88-4fb9-b4d2-92e48619e92f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:22.761187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f5ef3-82ab-4ba3-a289-3f2a2656e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:22.761814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f5ef3-82ab-4ba3-a289-3f2a2656e128 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:22.762107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f5ef3-82ab-4ba3-a289-3f2a2656e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:22.762395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f5ef3-82ab-4ba3-a289-3f2a2656e128 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:22.763337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f5ef3-82ab-4ba3-a289-3f2a2656e128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:22.775831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812c2e-6335-443f-9b58-a6a39f3d9b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:22.776457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812c2e-6335-443f-9b58-a6a39f3d9b06 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:22.776752 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812c2e-6335-443f-9b58-a6a39f3d9b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:22.777040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812c2e-6335-443f-9b58-a6a39f3d9b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:22.777745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812c2e-6335-443f-9b58-a6a39f3d9b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:22.819886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f5ef3-82ab-4ba3-a289-3f2a2656e128 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:22.822223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812c2e-6335-443f-9b58-a6a39f3d9b06 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:22.841758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 885/1758] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:22 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:22.843035 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f5ef3-82ab-4ba3-a289-3f2a2656e128 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:22.856802 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f5ef3-82ab-4ba3-a289-3f2a2656e128 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:22.858136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 874/1759] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:22 2021] GET /identity/v3/roles => generated 1420 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:22.859420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812c2e-6335-443f-9b58-a6a39f3d9b06 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:22.869111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718f86d-42d2-48cc-8246-15e8849ec2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:22.870012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f86d-42d2-48cc-8246-15e8849ec2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:22.870309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f86d-42d2-48cc-8246-15e8849ec2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:22.870594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f86d-42d2-48cc-8246-15e8849ec2e1 admin admin] PATH_INFO: `/v3/projects/81825719d57c4952a4843482bb23776f/users/3dcb97d1f0f348918ebc327e6af6e27c/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:22.903217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812c2e-6335-443f-9b58-a6a39f3d9b06 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:22.912826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077d5ce-3401-4dd2-aad0-99c2c44dfb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:22.916526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077d5ce-3401-4dd2-aad0-99c2c44dfb95 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:22.917031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077d5ce-3401-4dd2-aad0-99c2c44dfb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:22.917491 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077d5ce-3401-4dd2-aad0-99c2c44dfb95 admin admin] PATH_INFO: `/v3/projects/d5a9616987af499b8ef9fcdb1a513eff/users/1ad97924e7564fed8f425147b1bbdb35/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:22.920247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077d5ce-3401-4dd2-aad0-99c2c44dfb95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a9616987af499b8ef9fcdb1a513eff, user_id=1ad97924e7564fed8f425147b1bbdb35, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:22.966738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077d5ce-3401-4dd2-aad0-99c2c44dfb95 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:22.984958 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 875/1760] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:22 2021] PUT /identity/v3/projects/d5a9616987af499b8ef9fcdb1a513eff/users/1ad97924e7564fed8f425147b1bbdb35/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:22.986214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077d5ce-3401-4dd2-aad0-99c2c44dfb95 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:23.007899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718f86d-42d2-48cc-8246-15e8849ec2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81825719d57c4952a4843482bb23776f, user_id=3dcb97d1f0f348918ebc327e6af6e27c, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:23.035795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718f86d-42d2-48cc-8246-15e8849ec2e1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:23.062078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 886/1761] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:22 2021] PUT /identity/v3/projects/81825719d57c4952a4843482bb23776f/users/3dcb97d1f0f348918ebc327e6af6e27c/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:23.073032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa82630-3cc7-48c4-8b8b-6f6c5c33bc6c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:23.073483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa82630-3cc7-48c4-8b8b-6f6c5c33bc6c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:23.073951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa82630-3cc7-48c4-8b8b-6f6c5c33bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:23.107798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077d5ce-3401-4dd2-aad0-99c2c44dfb95 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:23.143812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-afa82630-3cc7-48c4-8b8b-6f6c5c33bc6c None None] MFA Rules not processed for user `3dcb97d1f0f348918ebc327e6af6e27c`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:23.144592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-afa82630-3cc7-48c4-8b8b-6f6c5c33bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:23.242856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfde3c8-76b8-4d9c-86dd-3836ce9b0331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:23.243744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfde3c8-76b8-4d9c-86dd-3836ce9b0331 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:23.245362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfde3c8-76b8-4d9c-86dd-3836ce9b0331 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:23.245818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfde3c8-76b8-4d9c-86dd-3836ce9b0331 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:23.248886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfde3c8-76b8-4d9c-86dd-3836ce9b0331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:23.270471 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 887/1762] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:23 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:23.271626 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa82630-3cc7-48c4-8b8b-6f6c5c33bc6c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:23.286198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa82630-3cc7-48c4-8b8b-6f6c5c33bc6c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:23.291371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eee02-65c8-462e-a71d-890956e6c140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:23.291986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eee02-65c8-462e-a71d-890956e6c140 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:23.292281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eee02-65c8-462e-a71d-890956e6c140 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:23.292569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eee02-65c8-462e-a71d-890956e6c140 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:23.293219 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eee02-65c8-462e-a71d-890956e6c140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:23.308472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfde3c8-76b8-4d9c-86dd-3836ce9b0331 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:23.319919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eee02-65c8-462e-a71d-890956e6c140 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:23.325019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 876/1763] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:22 2021] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:23.329041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfde3c8-76b8-4d9c-86dd-3836ce9b0331 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:23.351206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfde3c8-76b8-4d9c-86dd-3836ce9b0331 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:23.366358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c731f-aeb1-4f93-9008-8c2918f2b0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:23.367670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c731f-aeb1-4f93-9008-8c2918f2b0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:23.367670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c731f-aeb1-4f93-9008-8c2918f2b0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:23.368106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c731f-aeb1-4f93-9008-8c2918f2b0cf admin admin] PATH_INFO: `/v3/projects/d5a9616987af499b8ef9fcdb1a513eff/users/1ad97924e7564fed8f425147b1bbdb35/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:23.374513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c731f-aeb1-4f93-9008-8c2918f2b0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a9616987af499b8ef9fcdb1a513eff, user_id=1ad97924e7564fed8f425147b1bbdb35, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:23.391555 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 888/1764] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:23 2021] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:23.395117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eee02-65c8-462e-a71d-890956e6c140 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:23.437512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c731f-aeb1-4f93-9008-8c2918f2b0cf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:23.481895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 877/1765] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:23 2021] PUT /identity/v3/projects/d5a9616987af499b8ef9fcdb1a513eff/users/1ad97924e7564fed8f425147b1bbdb35/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:23.484189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c3f81-7b39-4558-90b3-c3dc8334136b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:23.484474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c3f81-7b39-4558-90b3-c3dc8334136b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:23.484869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c3f81-7b39-4558-90b3-c3dc8334136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:23.519831 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eee02-65c8-462e-a71d-890956e6c140 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:23.576817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-fc8c3f81-7b39-4558-90b3-c3dc8334136b None None] MFA Rules not processed for user `1ad97924e7564fed8f425147b1bbdb35`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:23.578205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fc8c3f81-7b39-4558-90b3-c3dc8334136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:23.687446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055da729-3e46-4697-9fac-7731fb1b74e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:23.689609 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da729-3e46-4697-9fac-7731fb1b74e6 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:23.689887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da729-3e46-4697-9fac-7731fb1b74e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:23.690185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055da729-3e46-4697-9fac-7731fb1b74e6 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:23.690900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055da729-3e46-4697-9fac-7731fb1b74e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:23.742261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 878/1766] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:23 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:23.759875 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055da729-3e46-4697-9fac-7731fb1b74e6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:23.804838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 889/1767] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:23 2021] POST /identity/v3/users => generated 295 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:23.810298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c3f81-7b39-4558-90b3-c3dc8334136b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:23.827808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c3f81-7b39-4558-90b3-c3dc8334136b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:23.843450 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f718f-3817-4172-8b14-7b5b8afa8c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:23.844082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f718f-3817-4172-8b14-7b5b8afa8c24 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:23.844379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f718f-3817-4172-8b14-7b5b8afa8c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:23.845293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f718f-3817-4172-8b14-7b5b8afa8c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:23.845435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f718f-3817-4172-8b14-7b5b8afa8c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:23.884806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f718f-3817-4172-8b14-7b5b8afa8c24 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:23.924347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 879/1768] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:23 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:23.925381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055da729-3e46-4697-9fac-7731fb1b74e6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:23.946824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055da729-3e46-4697-9fac-7731fb1b74e6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:23.949124 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f718f-3817-4172-8b14-7b5b8afa8c24 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:23.951380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4d8f718f-3817-4172-8b14-7b5b8afa8c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:23.954917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127f40a-45fb-40e5-a284-f5fafd0661d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:23.955829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127f40a-45fb-40e5-a284-f5fafd0661d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:23.956195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127f40a-45fb-40e5-a284-f5fafd0661d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:23.956546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127f40a-45fb-40e5-a284-f5fafd0661d7 admin admin] PATH_INFO: `/v3/projects/74374eba7dca44d9826c74e5d308914e/users/453e19d19768457e93d558cd814acc46/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:24.003404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127f40a-45fb-40e5-a284-f5fafd0661d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74374eba7dca44d9826c74e5d308914e, user_id=453e19d19768457e93d558cd814acc46, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:24.041715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127f40a-45fb-40e5-a284-f5fafd0661d7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:24.065542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 890/1769] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:23 2021] PUT /identity/v3/projects/74374eba7dca44d9826c74e5d308914e/users/453e19d19768457e93d558cd814acc46/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:24.072506 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127f40a-45fb-40e5-a284-f5fafd0661d7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:24.100740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f718f-3817-4172-8b14-7b5b8afa8c24 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:24.159337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127f40a-45fb-40e5-a284-f5fafd0661d7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:24.165576 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c177f-5c26-4ba8-91eb-1e889485da9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:24.166378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c177f-5c26-4ba8-91eb-1e889485da9d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:24.166773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c177f-5c26-4ba8-91eb-1e889485da9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:24.167139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c177f-5c26-4ba8-91eb-1e889485da9d admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:24.168114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c177f-5c26-4ba8-91eb-1e889485da9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:24.183214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a15c92-3c11-42fe-96d5-3ec4b2840836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:24.184122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a15c92-3c11-42fe-96d5-3ec4b2840836 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:24.184613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a15c92-3c11-42fe-96d5-3ec4b2840836 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:24.185116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a15c92-3c11-42fe-96d5-3ec4b2840836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:24.234882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c177f-5c26-4ba8-91eb-1e889485da9d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:24.274810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 891/1770] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:24 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:24.276993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c177f-5c26-4ba8-91eb-1e889485da9d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:24.296294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c177f-5c26-4ba8-91eb-1e889485da9d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:24.300880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a15c92-3c11-42fe-96d5-3ec4b2840836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:24.307226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc95147-f6d6-427e-af62-b4514cbe930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:24.308068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc95147-f6d6-427e-af62-b4514cbe930c admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:24.309120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc95147-f6d6-427e-af62-b4514cbe930c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:24.309416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc95147-f6d6-427e-af62-b4514cbe930c admin admin] PATH_INFO: `/v3/projects/74374eba7dca44d9826c74e5d308914e/users/453e19d19768457e93d558cd814acc46/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:24.314877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc95147-f6d6-427e-af62-b4514cbe930c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74374eba7dca44d9826c74e5d308914e, user_id=453e19d19768457e93d558cd814acc46, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:24.330909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a15c92-3c11-42fe-96d5-3ec4b2840836 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:24.343229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 880/1771] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:23 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:24.376155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc95147-f6d6-427e-af62-b4514cbe930c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:24.399555 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 892/1772] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:24 2021] PUT /identity/v3/projects/74374eba7dca44d9826c74e5d308914e/users/453e19d19768457e93d558cd814acc46/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:24.403424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a15c92-3c11-42fe-96d5-3ec4b2840836 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:24.416442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a15c92-3c11-42fe-96d5-3ec4b2840836 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:24.522959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581aaf-6716-454e-8ede-27f5477e5cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:24.523604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581aaf-6716-454e-8ede-27f5477e5cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:24.523901 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581aaf-6716-454e-8ede-27f5477e5cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:24.524256 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581aaf-6716-454e-8ede-27f5477e5cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:24.525171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6581aaf-6716-454e-8ede-27f5477e5cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:24.535010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc95147-f6d6-427e-af62-b4514cbe930c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:24.536669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-adc95147-f6d6-427e-af62-b4514cbe930c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:24.564192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6581aaf-6716-454e-8ede-27f5477e5cb1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:24.586886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 881/1773] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:24 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:24.591344 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581aaf-6716-454e-8ede-27f5477e5cb1 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:24.603687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581aaf-6716-454e-8ede-27f5477e5cb1 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:24.609731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa663ed7-522d-453d-a9e5-630a846d988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:24.611664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa663ed7-522d-453d-a9e5-630a846d988c admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:24.613942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa663ed7-522d-453d-a9e5-630a846d988c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:24.614108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa663ed7-522d-453d-a9e5-630a846d988c admin admin] PATH_INFO: `/v3/projects/74374eba7dca44d9826c74e5d308914e/users/453e19d19768457e93d558cd814acc46/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:24.617820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa663ed7-522d-453d-a9e5-630a846d988c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74374eba7dca44d9826c74e5d308914e, user_id=453e19d19768457e93d558cd814acc46, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:24.649135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa663ed7-522d-453d-a9e5-630a846d988c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:24.657437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc95147-f6d6-427e-af62-b4514cbe930c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:24.668345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 882/1774] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:24 2021] PUT /identity/v3/projects/74374eba7dca44d9826c74e5d308914e/users/453e19d19768457e93d558cd814acc46/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:24.678161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e9fb7-1a9e-48e5-b8ec-256bf03f566f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:24.678483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e9fb7-1a9e-48e5-b8ec-256bf03f566f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:24.678829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e9fb7-1a9e-48e5-b8ec-256bf03f566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:24.725261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b25e9fb7-1a9e-48e5-b8ec-256bf03f566f None None] MFA Rules not processed for user `453e19d19768457e93d558cd814acc46`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:24.726699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b25e9fb7-1a9e-48e5-b8ec-256bf03f566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:24.778234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c19368-17c6-4fca-bd9c-57adc05071ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:24.779516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c19368-17c6-4fca-bd9c-57adc05071ec service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:24.779886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c19368-17c6-4fca-bd9c-57adc05071ec service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:24.780340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c19368-17c6-4fca-bd9c-57adc05071ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:24.843329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 883/1775] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:24 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:24.864700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e9fb7-1a9e-48e5-b8ec-256bf03f566f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:24.884561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e9fb7-1a9e-48e5-b8ec-256bf03f566f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:24.888121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e7440-eeff-463e-9e19-756a98620a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:24.888782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e7440-eeff-463e-9e19-756a98620a85 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:24.889139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e7440-eeff-463e-9e19-756a98620a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:24.889490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e7440-eeff-463e-9e19-756a98620a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:24.889847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c19368-17c6-4fca-bd9c-57adc05071ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:24.899378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e7440-eeff-463e-9e19-756a98620a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:24.916995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c19368-17c6-4fca-bd9c-57adc05071ec service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:24.925947 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e7440-eeff-463e-9e19-756a98620a85 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:24.926827 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 893/1776] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:24 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:24.937063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 884/1777] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:24 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:25.122013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c19368-17c6-4fca-bd9c-57adc05071ec service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:25.130643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c19368-17c6-4fca-bd9c-57adc05071ec service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:25.135127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a98c4-8654-43a7-8561-f9c568201442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:25.135727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a98c4-8654-43a7-8561-f9c568201442 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:25.136005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a98c4-8654-43a7-8561-f9c568201442 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:25.136436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a98c4-8654-43a7-8561-f9c568201442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:25.253262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a98c4-8654-43a7-8561-f9c568201442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:25.280385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a98c4-8654-43a7-8561-f9c568201442 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:25.290507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 894/1778] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:25 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:28.296483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e7440-eeff-463e-9e19-756a98620a85 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:28.381137 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e7440-eeff-463e-9e19-756a98620a85 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:28.385544 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:28.386500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:28.386827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:28.387118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] PATH_INFO: `/v3/users/ce2909e8033e4f19a4c8679fb2916a21` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:28.388218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2909e8033e4f19a4c8679fb2916a21)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:28.415547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:28.468224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2909e8033e4f19a4c8679fb2916a21'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:28.482565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2909e8033e4f19a4c8679fb2916a21'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:28.483276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2909e8033e4f19a4c8679fb2916a21'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:28.492037 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2909e8033e4f19a4c8679fb2916a21'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:28.502970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2909e8033e4f19a4c8679fb2916a21'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:28.510099 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 885/1779] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:28 2021] DELETE /identity/v3/users/ce2909e8033e4f19a4c8679fb2916a21 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:28.514685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214762f9-1e3d-4a31-a263-8b87d8ac01e7 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:28.515163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214762f9-1e3d-4a31-a263-8b87d8ac01e7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:28.515328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214762f9-1e3d-4a31-a263-8b87d8ac01e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:28.538328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-214762f9-1e3d-4a31-a263-8b87d8ac01e7 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:28.539511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-214762f9-1e3d-4a31-a263-8b87d8ac01e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:28.606084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 895/1780] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:28.618146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:28.619581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:28.689060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68342845-a20a-4074-b4e9-74b311066473 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:28.692772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552dab-a2f8-4407-b228-a8acc1faca8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:28.694088 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552dab-a2f8-4407-b228-a8acc1faca8a service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:28.694516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552dab-a2f8-4407-b228-a8acc1faca8a service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:28.695125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552dab-a2f8-4407-b228-a8acc1faca8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:28.706753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e552dab-a2f8-4407-b228-a8acc1faca8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:28.739001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e552dab-a2f8-4407-b228-a8acc1faca8a service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:28.747458 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 886/1781] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:29.289010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214762f9-1e3d-4a31-a263-8b87d8ac01e7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:29.290932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-214762f9-1e3d-4a31-a263-8b87d8ac01e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:29.305595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214762f9-1e3d-4a31-a263-8b87d8ac01e7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:29.311575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:29.312426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:29.312692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:29.312979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] PATH_INFO: `/v3/projects/c25ef4d6e28147b8ab2d9ada03cb2d3b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:29.314192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25ef4d6e28147b8ab2d9ada03cb2d3b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:29.347662 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:29.348783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552dab-a2f8-4407-b228-a8acc1faca8a service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:29.351347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9e552dab-a2f8-4407-b228-a8acc1faca8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:29.366859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552dab-a2f8-4407-b228-a8acc1faca8a service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:29.373539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:29.374592 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:29.375259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:29.375676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] PATH_INFO: `/v3/users/0600b670b0b04c0496bcaa65ce876517` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:29.377073 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0600b670b0b04c0496bcaa65ce876517)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:29.403880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:29.475827 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25ef4d6e28147b8ab2d9ada03cb2d3b', 'request_id': 'req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.480546 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0600b670b0b04c0496bcaa65ce876517'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.507999 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0600b670b0b04c0496bcaa65ce876517'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.508708 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0600b670b0b04c0496bcaa65ce876517'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.519389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25ef4d6e28147b8ab2d9ada03cb2d3b', 'request_id': 'req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.527786 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0600b670b0b04c0496bcaa65ce876517'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.537709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25ef4d6e28147b8ab2d9ada03cb2d3b', 'request_id': 'req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.545600 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-fcc2bff2-9cbb-4060-9393-03d19be5443e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0600b670b0b04c0496bcaa65ce876517'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.561635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 887/1782] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:29 2021] DELETE /identity/v3/users/0600b670b0b04c0496bcaa65ce876517 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:29.567471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3577e-14bb-4cf3-be09-730af152f14e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:29.568192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3577e-14bb-4cf3-be09-730af152f14e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:29.568449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3577e-14bb-4cf3-be09-730af152f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:29.574337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] The token cache is being invalidate because project c25ef4d6e28147b8ab2d9ada03cb2d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:29.574676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.575677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.577539 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 896/1783] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:29 2021] DELETE /identity/v3/projects/c25ef4d6e28147b8ab2d9ada03cb2d3b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:29.582442 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:29.584368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:29.603426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-75b3577e-14bb-4cf3-be09-730af152f14e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:29.605297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-75b3577e-14bb-4cf3-be09-730af152f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:29.734106 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadae82d-5c6c-4dbd-a61c-361c12eaedcd admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:29.738778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 888/1784] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:29.742837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:29.742837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:29.742837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:29.742837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] PATH_INFO: `/v3/users/1ad97924e7564fed8f425147b1bbdb35` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:29.749783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad97924e7564fed8f425147b1bbdb35)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:29.753197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3577e-14bb-4cf3-be09-730af152f14e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:29.755102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-75b3577e-14bb-4cf3-be09-730af152f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:29.778384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:29.845550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad97924e7564fed8f425147b1bbdb35'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.849672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3577e-14bb-4cf3-be09-730af152f14e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:29.853917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a95e30-dd11-4011-9553-89f262c34909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:29.854594 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95e30-dd11-4011-9553-89f262c34909 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:29.855091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95e30-dd11-4011-9553-89f262c34909 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:29.855367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95e30-dd11-4011-9553-89f262c34909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:29.860941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad97924e7564fed8f425147b1bbdb35'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.862114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad97924e7564fed8f425147b1bbdb35'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.867757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a95e30-dd11-4011-9553-89f262c34909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:29.873386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad97924e7564fed8f425147b1bbdb35'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.883824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-dd18cf38-ed58-4b3f-994d-09beaf323dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad97924e7564fed8f425147b1bbdb35'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:29.895637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 897/1785] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:29 2021] DELETE /identity/v3/users/1ad97924e7564fed8f425147b1bbdb35 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:29.904893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a95e30-dd11-4011-9553-89f262c34909 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:29.917625 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 889/1786] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:30.007342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036078f9-45b2-4d94-a76e-fee4ea7a9189 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:30.007647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036078f9-45b2-4d94-a76e-fee4ea7a9189 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:30.007940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036078f9-45b2-4d94-a76e-fee4ea7a9189 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:30.010155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 898/1787] 10.222.0.36 () {54 vars in 921 bytes} [Wed Oct 27 14:12:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:12:30.018923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7269ae-bbf4-4c48-80f6-dfcee5bb4bd7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:30.019220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7269ae-bbf4-4c48-80f6-dfcee5bb4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:30.019539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7269ae-bbf4-4c48-80f6-dfcee5bb4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:30.074041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-3a7269ae-bbf4-4c48-80f6-dfcee5bb4bd7 None None] MFA Rules not processed for user `a523c35d222f464e9d4f78ae990e3a17`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:30.075260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3a7269ae-bbf4-4c48-80f6-dfcee5bb4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:30.262281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 890/1788] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Oct 27 14:12:30 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:30.361060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036078f9-45b2-4d94-a76e-fee4ea7a9189 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:30.368841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-036078f9-45b2-4d94-a76e-fee4ea7a9189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:30.406615 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036078f9-45b2-4d94-a76e-fee4ea7a9189 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:30.412941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c02537-96b8-4481-a1b0-5f29d790856c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:30.413906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c02537-96b8-4481-a1b0-5f29d790856c service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:30.414347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c02537-96b8-4481-a1b0-5f29d790856c service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:30.414816 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c02537-96b8-4481-a1b0-5f29d790856c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:30.425300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c02537-96b8-4481-a1b0-5f29d790856c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:30.456603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c02537-96b8-4481-a1b0-5f29d790856c service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:30.470000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 899/1789] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:30 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:30.569312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7269ae-bbf4-4c48-80f6-dfcee5bb4bd7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:30.571375 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3a7269ae-bbf4-4c48-80f6-dfcee5bb4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:30.642076 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c02537-96b8-4481-a1b0-5f29d790856c service nova] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:30.644088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-78c02537-96b8-4481-a1b0-5f29d790856c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:30.689738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7269ae-bbf4-4c48-80f6-dfcee5bb4bd7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:30.695131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:30.696261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:30.696559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:30.696847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] PATH_INFO: `/v3/projects/d5a9616987af499b8ef9fcdb1a513eff` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:30.697957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a9616987af499b8ef9fcdb1a513eff)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:30.726898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:30.735263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c02537-96b8-4481-a1b0-5f29d790856c service nova] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:30.742009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:30.743109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:30.743402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:30.743689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] PATH_INFO: `/v3/projects/3b0c239f878f491b955f083b1320dcd3` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:30.744950 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0c239f878f491b955f083b1320dcd3)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:30.772478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:30.797713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a9616987af499b8ef9fcdb1a513eff', 'request_id': 'req-1d0b6661-0b96-43fc-8888-fafb3561ac07'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.816794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a9616987af499b8ef9fcdb1a513eff', 'request_id': 'req-1d0b6661-0b96-43fc-8888-fafb3561ac07'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.825714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a9616987af499b8ef9fcdb1a513eff', 'request_id': 'req-1d0b6661-0b96-43fc-8888-fafb3561ac07'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.847193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] The token cache is being invalidate because project d5a9616987af499b8ef9fcdb1a513eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:30.848022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.848164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0c239f878f491b955f083b1320dcd3', 'request_id': 'req-894d7d6b-f433-405d-b47b-223783b161ec'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.849612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1d0b6661-0b96-43fc-8888-fafb3561ac07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.852289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 891/1790] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:30 2021] DELETE /identity/v3/projects/d5a9616987af499b8ef9fcdb1a513eff => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:30.857983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604fa06-e7cb-4873-82ea-9f97deb03910 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:30.858286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604fa06-e7cb-4873-82ea-9f97deb03910 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:30.858766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604fa06-e7cb-4873-82ea-9f97deb03910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:30.868600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0c239f878f491b955f083b1320dcd3', 'request_id': 'req-894d7d6b-f433-405d-b47b-223783b161ec'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.877470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0c239f878f491b955f083b1320dcd3', 'request_id': 'req-894d7d6b-f433-405d-b47b-223783b161ec'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.887473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-0604fa06-e7cb-4873-82ea-9f97deb03910 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:30.889197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0604fa06-e7cb-4873-82ea-9f97deb03910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:30.897405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] The token cache is being invalidate because project 3b0c239f878f491b955f083b1320dcd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:30.898329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.899437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:30.904881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 900/1791] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:30 2021] DELETE /identity/v3/projects/3b0c239f878f491b955f083b1320dcd3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:30.906338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:30.908069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:31.002823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 892/1792] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:31.004476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09287707-da62-49df-b297-ee2103f1bcd9 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:31.004774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09287707-da62-49df-b297-ee2103f1bcd9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:31.005064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09287707-da62-49df-b297-ee2103f1bcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:31.016480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d7d6b-f433-405d-b47b-223783b161ec admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:31.022263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:31.023207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:31.023425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:31.023705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] PATH_INFO: `/v3/users/3dcb97d1f0f348918ebc327e6af6e27c` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:31.025882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcb97d1f0f348918ebc327e6af6e27c)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:31.048729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-09287707-da62-49df-b297-ee2103f1bcd9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:31.049899 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-09287707-da62-49df-b297-ee2103f1bcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:31.064279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:31.071471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 893/1793] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:31.073603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09287707-da62-49df-b297-ee2103f1bcd9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:31.089628 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09287707-da62-49df-b297-ee2103f1bcd9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:31.097997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbb71b-41ef-408e-b359-e853e1153039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:31.100094 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbb71b-41ef-408e-b359-e853e1153039 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:31.100622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbb71b-41ef-408e-b359-e853e1153039 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:31.101035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbb71b-41ef-408e-b359-e853e1153039 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:31.102338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbb71b-41ef-408e-b359-e853e1153039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:31.102989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbb71b-41ef-408e-b359-e853e1153039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:31.151328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcb97d1f0f348918ebc327e6af6e27c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:31.152915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbb71b-41ef-408e-b359-e853e1153039 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:31.165924 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcb97d1f0f348918ebc327e6af6e27c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:31.166711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcb97d1f0f348918ebc327e6af6e27c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:31.174281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 894/1794] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:12:31.175590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbb71b-41ef-408e-b359-e853e1153039 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:31.176615 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcb97d1f0f348918ebc327e6af6e27c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:31.186535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcb97d1f0f348918ebc327e6af6e27c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:31.188433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbb71b-41ef-408e-b359-e853e1153039 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:31.192998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d7571-406d-46ae-9234-dc430a8cb323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:31.193686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d7571-406d-46ae-9234-dc430a8cb323 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:31.194050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d7571-406d-46ae-9234-dc430a8cb323 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:31.194406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d7571-406d-46ae-9234-dc430a8cb323 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:31.195154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d7571-406d-46ae-9234-dc430a8cb323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:31.199502 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 901/1795] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:30 2021] DELETE /identity/v3/users/3dcb97d1f0f348918ebc327e6af6e27c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:31.263239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d7571-406d-46ae-9234-dc430a8cb323 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:31.316754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 895/1796] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:31 2021] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:31.321044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:31.322474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:31.541831 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227edee-a43e-4780-b15a-2c9f7e9acee6 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:31.626961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca241a-8bbf-4758-9f21-3bf788767585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:31.627592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca241a-8bbf-4758-9f21-3bf788767585 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:31.627891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca241a-8bbf-4758-9f21-3bf788767585 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:31.628320 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca241a-8bbf-4758-9f21-3bf788767585 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:31.629139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca241a-8bbf-4758-9f21-3bf788767585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:31.656174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca241a-8bbf-4758-9f21-3bf788767585 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:31.680467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 902/1797] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:31 2021] POST /identity/v3/users => generated 285 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:31.684829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d7571-406d-46ae-9234-dc430a8cb323 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:31.695767 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d7571-406d-46ae-9234-dc430a8cb323 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:31.700407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73524b0d-893d-4054-a9da-aead2f77ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:31.701020 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73524b0d-893d-4054-a9da-aead2f77ab2d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:31.701314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73524b0d-893d-4054-a9da-aead2f77ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:31.701601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73524b0d-893d-4054-a9da-aead2f77ab2d admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:31.702339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73524b0d-893d-4054-a9da-aead2f77ab2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:31.728606 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73524b0d-893d-4054-a9da-aead2f77ab2d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:31.739443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 896/1798] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:31 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:31.743793 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca241a-8bbf-4758-9f21-3bf788767585 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:31.753182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca241a-8bbf-4758-9f21-3bf788767585 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:31.757962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520dd3f-8ab2-44fb-a7af-d1757f437ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:31.758824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520dd3f-8ab2-44fb-a7af-d1757f437ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:31.759116 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520dd3f-8ab2-44fb-a7af-d1757f437ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:31.759400 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520dd3f-8ab2-44fb-a7af-d1757f437ef5 admin admin] PATH_INFO: `/v3/projects/f9f83908444d41f38d1ae81b8d70d856/users/45dbcb99db474f1c8f94cc038e2e65e6/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:31.780898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520dd3f-8ab2-44fb-a7af-d1757f437ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f83908444d41f38d1ae81b8d70d856, user_id=45dbcb99db474f1c8f94cc038e2e65e6, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:31.806521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73524b0d-893d-4054-a9da-aead2f77ab2d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:31.808473 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-73524b0d-893d-4054-a9da-aead2f77ab2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:31.811017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520dd3f-8ab2-44fb-a7af-d1757f437ef5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:31.822520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73524b0d-893d-4054-a9da-aead2f77ab2d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:31.826459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 903/1799] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:31 2021] PUT /identity/v3/projects/f9f83908444d41f38d1ae81b8d70d856/users/45dbcb99db474f1c8f94cc038e2e65e6/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:31.837678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70527f2-137e-4cbe-8cbf-a68c8ec3019e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:31.837970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70527f2-137e-4cbe-8cbf-a68c8ec3019e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:31.838258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70527f2-137e-4cbe-8cbf-a68c8ec3019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:31.875083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c70527f2-137e-4cbe-8cbf-a68c8ec3019e None None] MFA Rules not processed for user `45dbcb99db474f1c8f94cc038e2e65e6`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:31.876243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c70527f2-137e-4cbe-8cbf-a68c8ec3019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:31.889675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:31.890477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:31.890806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:31.891091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] PATH_INFO: `/v3/projects/81825719d57c4952a4843482bb23776f` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:31.892198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81825719d57c4952a4843482bb23776f)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:31.924091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:31.952114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 904/1800] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:31 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:31.956763 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70527f2-137e-4cbe-8cbf-a68c8ec3019e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:31.969009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70527f2-137e-4cbe-8cbf-a68c8ec3019e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:31.976706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81825719d57c4952a4843482bb23776f', 'request_id': 'req-2a0798d3-74eb-4354-a10f-2440c6c5de15'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:31.990582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81825719d57c4952a4843482bb23776f', 'request_id': 'req-2a0798d3-74eb-4354-a10f-2440c6c5de15'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:31.998830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81825719d57c4952a4843482bb23776f', 'request_id': 'req-2a0798d3-74eb-4354-a10f-2440c6c5de15'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:32.011451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] The token cache is being invalidate because project 81825719d57c4952a4843482bb23776f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:32.011739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:32.012457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:32.014175 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 897/1801] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:31 2021] DELETE /identity/v3/projects/81825719d57c4952a4843482bb23776f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:32.018129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:32.019262 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:32.042513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0dc5e-fbf1-47ac-8d2a-8a18a8ecb0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:32.043160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0dc5e-fbf1-47ac-8d2a-8a18a8ecb0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:32.043458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0dc5e-fbf1-47ac-8d2a-8a18a8ecb0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:32.043813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0dc5e-fbf1-47ac-8d2a-8a18a8ecb0c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:32.044543 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0dc5e-fbf1-47ac-8d2a-8a18a8ecb0c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:32.072187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0dc5e-fbf1-47ac-8d2a-8a18a8ecb0c3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:32.089534 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0798d3-74eb-4354-a10f-2440c6c5de15 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:32.093818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:32.094715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:32.094959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:32.095246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] PATH_INFO: `/v3/users/453e19d19768457e93d558cd814acc46` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:32.096346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] RBAC: Authorizing `identity:delete_user(user_id=453e19d19768457e93d558cd814acc46)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:32.101091 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 905/1802] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:31 2021] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:32.102021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0dc5e-fbf1-47ac-8d2a-8a18a8ecb0c3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:32.103618 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-55e0dc5e-fbf1-47ac-8d2a-8a18a8ecb0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:32.123799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:32.179338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453e19d19768457e93d558cd814acc46'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:32.181876 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0dc5e-fbf1-47ac-8d2a-8a18a8ecb0c3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:32.187306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e486c-96a8-49b9-8752-6fa8d9f75523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:32.188186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e486c-96a8-49b9-8752-6fa8d9f75523 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:32.188293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e486c-96a8-49b9-8752-6fa8d9f75523 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:32.188655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e486c-96a8-49b9-8752-6fa8d9f75523 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:32.189271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e486c-96a8-49b9-8752-6fa8d9f75523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:32.191987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453e19d19768457e93d558cd814acc46'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:32.192682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453e19d19768457e93d558cd814acc46'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:32.202251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453e19d19768457e93d558cd814acc46'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:32.210381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453e19d19768457e93d558cd814acc46'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:32.217584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e486c-96a8-49b9-8752-6fa8d9f75523 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:32.218342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 898/1803] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:32 2021] DELETE /identity/v3/users/453e19d19768457e93d558cd814acc46 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:32.243773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 906/1804] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:32 2021] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:32.245446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:32.246940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:32.341977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367be38-dccc-4794-a6fe-fce46ced51df admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:32.348860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64517-be08-4b49-a591-81191692e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:32.350651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64517-be08-4b49-a591-81191692e966 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:32.351007 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64517-be08-4b49-a591-81191692e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:32.351301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede64517-be08-4b49-a591-81191692e966 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:32.352681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede64517-be08-4b49-a591-81191692e966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:32.387816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede64517-be08-4b49-a591-81191692e966 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:32.401291 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 899/1805] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:32 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:32.405163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e486c-96a8-49b9-8752-6fa8d9f75523 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:32.416106 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e486c-96a8-49b9-8752-6fa8d9f75523 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:32.421701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fd161-aa32-4f7c-b51c-019a0381bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:32.422587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fd161-aa32-4f7c-b51c-019a0381bce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:32.422973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fd161-aa32-4f7c-b51c-019a0381bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:32.423663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fd161-aa32-4f7c-b51c-019a0381bce5 admin admin] PATH_INFO: `/v3/projects/6132d08267c9412fb03ab74532ca5d57/users/59a93db0ab634952a9bf04b4852d6c4b/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:32.448435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fd161-aa32-4f7c-b51c-019a0381bce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6132d08267c9412fb03ab74532ca5d57, user_id=59a93db0ab634952a9bf04b4852d6c4b, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:32.484341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fd161-aa32-4f7c-b51c-019a0381bce5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:32.511650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 907/1806] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:32 2021] PUT /identity/v3/projects/6132d08267c9412fb03ab74532ca5d57/users/59a93db0ab634952a9bf04b4852d6c4b/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:32.517388 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64517-be08-4b49-a591-81191692e966 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:32.557338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede64517-be08-4b49-a591-81191692e966 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:32.681603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07311add-1d23-4a6f-b6ad-328192aa8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:32.682824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07311add-1d23-4a6f-b6ad-328192aa8f18 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:32.683234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07311add-1d23-4a6f-b6ad-328192aa8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:32.683650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07311add-1d23-4a6f-b6ad-328192aa8f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:32.684509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07311add-1d23-4a6f-b6ad-328192aa8f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:32.717488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07311add-1d23-4a6f-b6ad-328192aa8f18 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:32.733637 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 900/1807] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:32 2021] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:32.735327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fd161-aa32-4f7c-b51c-019a0381bce5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:32.750026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fd161-aa32-4f7c-b51c-019a0381bce5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:32.762016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988225cc-3154-424e-a775-6e26985667c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:32.763844 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988225cc-3154-424e-a775-6e26985667c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:32.764214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988225cc-3154-424e-a775-6e26985667c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:32.764785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988225cc-3154-424e-a775-6e26985667c7 admin admin] PATH_INFO: `/v3/projects/6132d08267c9412fb03ab74532ca5d57/users/59a93db0ab634952a9bf04b4852d6c4b/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:32.769520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988225cc-3154-424e-a775-6e26985667c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6132d08267c9412fb03ab74532ca5d57, user_id=59a93db0ab634952a9bf04b4852d6c4b, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:32.836823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988225cc-3154-424e-a775-6e26985667c7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:32.851033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07311add-1d23-4a6f-b6ad-328192aa8f18 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:32.854211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-07311add-1d23-4a6f-b6ad-328192aa8f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:32.868159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 908/1808] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:32 2021] PUT /identity/v3/projects/6132d08267c9412fb03ab74532ca5d57/users/59a93db0ab634952a9bf04b4852d6c4b/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:32.877051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07311add-1d23-4a6f-b6ad-328192aa8f18 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:32.880018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988225cc-3154-424e-a775-6e26985667c7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:33.029753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:33.030567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.030887 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.031193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] PATH_INFO: `/v3/projects/74374eba7dca44d9826c74e5d308914e` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.035498 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74374eba7dca44d9826c74e5d308914e)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:33.062614 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988225cc-3154-424e-a775-6e26985667c7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:33.073939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b324b74-8342-47e7-a600-6becabb2f74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:33.074697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b324b74-8342-47e7-a600-6becabb2f74c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.074995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b324b74-8342-47e7-a600-6becabb2f74c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.075341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b324b74-8342-47e7-a600-6becabb2f74c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.076051 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b324b74-8342-47e7-a600-6becabb2f74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:33.081172 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:33.112994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b324b74-8342-47e7-a600-6becabb2f74c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:33.125575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 909/1809] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:32 2021] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:33.130157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b324b74-8342-47e7-a600-6becabb2f74c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:33.146754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b324b74-8342-47e7-a600-6becabb2f74c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:33.159128 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74374eba7dca44d9826c74e5d308914e', 'request_id': 'req-cd3d9269-b9ac-4efe-839a-ba54d855499d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:33.173832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74374eba7dca44d9826c74e5d308914e', 'request_id': 'req-cd3d9269-b9ac-4efe-839a-ba54d855499d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:33.183864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74374eba7dca44d9826c74e5d308914e', 'request_id': 'req-cd3d9269-b9ac-4efe-839a-ba54d855499d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:33.197474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] The token cache is being invalidate because project 74374eba7dca44d9826c74e5d308914e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:33.197837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:33.198430 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cd3d9269-b9ac-4efe-839a-ba54d855499d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:33.212365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 901/1810] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:32 2021] DELETE /identity/v3/projects/74374eba7dca44d9826c74e5d308914e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:33.219528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaa153-a206-49be-b88e-1db7bcabb230 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.219908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaa153-a206-49be-b88e-1db7bcabb230 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.220299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaa153-a206-49be-b88e-1db7bcabb230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.248716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-0ddaa153-a206-49be-b88e-1db7bcabb230 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:33.249891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae33bfb-0810-4411-bd5b-c1ff3c2f6164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:33.250375 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0ddaa153-a206-49be-b88e-1db7bcabb230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:33.250892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33bfb-0810-4411-bd5b-c1ff3c2f6164 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.251262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33bfb-0810-4411-bd5b-c1ff3c2f6164 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.251617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33bfb-0810-4411-bd5b-c1ff3c2f6164 admin admin] PATH_INFO: `/v3/projects/6132d08267c9412fb03ab74532ca5d57/users/59a93db0ab634952a9bf04b4852d6c4b/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.253692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae33bfb-0810-4411-bd5b-c1ff3c2f6164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6132d08267c9412fb03ab74532ca5d57, user_id=59a93db0ab634952a9bf04b4852d6c4b, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:33.266842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 902/1811] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:33.268560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d07a33-e0e3-4c9e-a54e-1a4faa15aa7a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.268974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d07a33-e0e3-4c9e-a54e-1a4faa15aa7a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.269222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d07a33-e0e3-4c9e-a54e-1a4faa15aa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.281734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae33bfb-0810-4411-bd5b-c1ff3c2f6164 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:33.321233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 910/1812] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:33 2021] PUT /identity/v3/projects/6132d08267c9412fb03ab74532ca5d57/users/59a93db0ab634952a9bf04b4852d6c4b/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:33.323901 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f599c9e-81fe-469e-85de-7f683671c0ae None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.324163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f599c9e-81fe-469e-85de-7f683671c0ae None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.324441 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f599c9e-81fe-469e-85de-7f683671c0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.325093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e4d07a33-e0e3-4c9e-a54e-1a4faa15aa7a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:33.327196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e4d07a33-e0e3-4c9e-a54e-1a4faa15aa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:33.371025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2f599c9e-81fe-469e-85de-7f683671c0ae None None] MFA Rules not processed for user `59a93db0ab634952a9bf04b4852d6c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:33.375662 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2f599c9e-81fe-469e-85de-7f683671c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:33.450984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 903/1813] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:33.451897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d07a33-e0e3-4c9e-a54e-1a4faa15aa7a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:33.462233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d07a33-e0e3-4c9e-a54e-1a4faa15aa7a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:33.467102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89738f-bb93-46a1-b3e4-c9a34fe9538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:33.467705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89738f-bb93-46a1-b3e4-c9a34fe9538d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.467992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89738f-bb93-46a1-b3e4-c9a34fe9538d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.468272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89738f-bb93-46a1-b3e4-c9a34fe9538d admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.468959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89738f-bb93-46a1-b3e4-c9a34fe9538d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:33.469257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89738f-bb93-46a1-b3e4-c9a34fe9538d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:33.486513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 911/1814] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:33 2021] POST /identity/v3/auth/tokens => generated 3741 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:33.497001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f599c9e-81fe-469e-85de-7f683671c0ae None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:33.498366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2f599c9e-81fe-469e-85de-7f683671c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:33.500831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89738f-bb93-46a1-b3e4-c9a34fe9538d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:33.515879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 904/1815] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:33.520346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89738f-bb93-46a1-b3e4-c9a34fe9538d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:33.530333 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89738f-bb93-46a1-b3e4-c9a34fe9538d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:33.534925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31005a83-a373-42d0-ba4d-aa62e68d52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:33.535516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31005a83-a373-42d0-ba4d-aa62e68d52cc admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.535803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31005a83-a373-42d0-ba4d-aa62e68d52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.536095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31005a83-a373-42d0-ba4d-aa62e68d52cc admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.536954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31005a83-a373-42d0-ba4d-aa62e68d52cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:33.570781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31005a83-a373-42d0-ba4d-aa62e68d52cc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:33.576065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f599c9e-81fe-469e-85de-7f683671c0ae None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:33.579547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a078586-c6da-4073-80a8-c756ce2974bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:33.580114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078586-c6da-4073-80a8-c756ce2974bb service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.580402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078586-c6da-4073-80a8-c756ce2974bb service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.580702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078586-c6da-4073-80a8-c756ce2974bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.590350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a078586-c6da-4073-80a8-c756ce2974bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:33.590560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 905/1816] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:33 2021] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:33.594720 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31005a83-a373-42d0-ba4d-aa62e68d52cc admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:33.617566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a078586-c6da-4073-80a8-c756ce2974bb service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:33.627503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 912/1817] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:33 2021] GET /identity/v3/auth/tokens => generated 3741 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:33.670501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31005a83-a373-42d0-ba4d-aa62e68d52cc admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:33.674861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749d2b1-4d30-4eab-ae34-d1850cdd2092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:33.675464 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749d2b1-4d30-4eab-ae34-d1850cdd2092 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.675761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749d2b1-4d30-4eab-ae34-d1850cdd2092 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.676078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749d2b1-4d30-4eab-ae34-d1850cdd2092 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.676677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749d2b1-4d30-4eab-ae34-d1850cdd2092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:33.703404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749d2b1-4d30-4eab-ae34-d1850cdd2092 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:33.726657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 906/1818] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:33 2021] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:33.729168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a078586-c6da-4073-80a8-c756ce2974bb service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:33.740256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a078586-c6da-4073-80a8-c756ce2974bb service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:33.745235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10445c-51de-4d44-8493-c9dc8a9504b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:33.745847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10445c-51de-4d44-8493-c9dc8a9504b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.746139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10445c-51de-4d44-8493-c9dc8a9504b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.746426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10445c-51de-4d44-8493-c9dc8a9504b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.747202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10445c-51de-4d44-8493-c9dc8a9504b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:33.772927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10445c-51de-4d44-8493-c9dc8a9504b4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:33.783711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 913/1819] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:33 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:33.788685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749d2b1-4d30-4eab-ae34-d1850cdd2092 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:33.803915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749d2b1-4d30-4eab-ae34-d1850cdd2092 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:33.808659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9a0f1-21ba-46c2-9b77-8c6f4cc2bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:33.809495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9a0f1-21ba-46c2-9b77-8c6f4cc2bd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.809783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9a0f1-21ba-46c2-9b77-8c6f4cc2bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.810066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9a0f1-21ba-46c2-9b77-8c6f4cc2bd98 admin admin] PATH_INFO: `/v3/projects/90824cc947bc498bb75761a071ff48dd/users/7700bc784b644c59884f489c2ae612e3/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.831328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9a0f1-21ba-46c2-9b77-8c6f4cc2bd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90824cc947bc498bb75761a071ff48dd, user_id=7700bc784b644c59884f489c2ae612e3, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:33.867156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9a0f1-21ba-46c2-9b77-8c6f4cc2bd98 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:33.882600 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 907/1820] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:33 2021] PUT /identity/v3/projects/90824cc947bc498bb75761a071ff48dd/users/7700bc784b644c59884f489c2ae612e3/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:33.896964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81345b39-0d81-4e48-834a-95b5e4d85ef3 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:33.897264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81345b39-0d81-4e48-834a-95b5e4d85ef3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:33.897549 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81345b39-0d81-4e48-834a-95b5e4d85ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:33.936420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-81345b39-0d81-4e48-834a-95b5e4d85ef3 None None] MFA Rules not processed for user `7700bc784b644c59884f489c2ae612e3`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:33.937557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-81345b39-0d81-4e48-834a-95b5e4d85ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:34.033099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 914/1821] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:33 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:34.045295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9a0f1-21ba-46c2-9b77-8c6f4cc2bd98 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:34.129346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9a0f1-21ba-46c2-9b77-8c6f4cc2bd98 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:34.133233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b04ee9-f7e3-467d-a213-639bb0917647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:34.133771 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04ee9-f7e3-467d-a213-639bb0917647 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:34.134062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04ee9-f7e3-467d-a213-639bb0917647 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:34.134346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04ee9-f7e3-467d-a213-639bb0917647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:34.143354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b04ee9-f7e3-467d-a213-639bb0917647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:34.169719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b04ee9-f7e3-467d-a213-639bb0917647 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:34.179080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 908/1822] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:34 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:35.512026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81345b39-0d81-4e48-834a-95b5e4d85ef3 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:35.513379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-81345b39-0d81-4e48-834a-95b5e4d85ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:35.584429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81345b39-0d81-4e48-834a-95b5e4d85ef3 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:35.588590 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:35.589389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:35.589680 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:35.589968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] PATH_INFO: `/v3/users/45dbcb99db474f1c8f94cc038e2e65e6` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:35.591097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45dbcb99db474f1c8f94cc038e2e65e6)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:35.618154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:35.669522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45dbcb99db474f1c8f94cc038e2e65e6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:35.681931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45dbcb99db474f1c8f94cc038e2e65e6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:35.682531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45dbcb99db474f1c8f94cc038e2e65e6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:35.690098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45dbcb99db474f1c8f94cc038e2e65e6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:35.697560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45dbcb99db474f1c8f94cc038e2e65e6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:35.703585 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 915/1823] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:35 2021] DELETE /identity/v3/users/45dbcb99db474f1c8f94cc038e2e65e6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:35.707993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d62224-c21e-4bd7-868d-79d2e5402875 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:35.709118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d62224-c21e-4bd7-868d-79d2e5402875 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:35.709118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d62224-c21e-4bd7-868d-79d2e5402875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:35.737995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-65d62224-c21e-4bd7-868d-79d2e5402875 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:35.739284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-65d62224-c21e-4bd7-868d-79d2e5402875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:35.842281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 909/1824] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:35.874828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:35.877180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:35.972392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0170-c470-4089-9ecc-b7b630601a56 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:35.976670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0a6a2-51c6-49c5-9ef0-6b59cbf32889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:35.977344 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0a6a2-51c6-49c5-9ef0-6b59cbf32889 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:35.977684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0a6a2-51c6-49c5-9ef0-6b59cbf32889 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:35.977971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0a6a2-51c6-49c5-9ef0-6b59cbf32889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:35.988094 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0a6a2-51c6-49c5-9ef0-6b59cbf32889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:36.028930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0a6a2-51c6-49c5-9ef0-6b59cbf32889 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:36.041981 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 916/1825] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:36.363461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d62224-c21e-4bd7-868d-79d2e5402875 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:36.366101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-65d62224-c21e-4bd7-868d-79d2e5402875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:36.396817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d62224-c21e-4bd7-868d-79d2e5402875 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:36.402100 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:36.403682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:36.404279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:36.405374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] PATH_INFO: `/v3/users/835cfeae0318483fa4106423e91df736` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:36.406917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835cfeae0318483fa4106423e91df736)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:36.437024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:36.475762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0a6a2-51c6-49c5-9ef0-6b59cbf32889 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:36.477267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ece0a6a2-51c6-49c5-9ef0-6b59cbf32889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:36.491641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0a6a2-51c6-49c5-9ef0-6b59cbf32889 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:36.508659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:36.509641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:36.509988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:36.510407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] PATH_INFO: `/v3/projects/f9f83908444d41f38d1ae81b8d70d856` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:36.512060 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f83908444d41f38d1ae81b8d70d856)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:36.544284 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:36.566347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835cfeae0318483fa4106423e91df736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.581586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835cfeae0318483fa4106423e91df736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.582236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835cfeae0318483fa4106423e91df736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.599350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835cfeae0318483fa4106423e91df736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.610491 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-310399d5-b2f4-428b-9d0a-9d1c41bb1f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835cfeae0318483fa4106423e91df736'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.621626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 910/1826] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:36 2021] DELETE /identity/v3/users/835cfeae0318483fa4106423e91df736 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:36.627129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf725759-4c52-4732-80e2-ab0a5ca222eb None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:36.627426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf725759-4c52-4732-80e2-ab0a5ca222eb None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:36.627716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf725759-4c52-4732-80e2-ab0a5ca222eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:36.632399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f83908444d41f38d1ae81b8d70d856', 'request_id': 'req-80fe693f-027a-4cd1-8219-821c5bfc8612'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.644155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f83908444d41f38d1ae81b8d70d856', 'request_id': 'req-80fe693f-027a-4cd1-8219-821c5bfc8612'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.653438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f83908444d41f38d1ae81b8d70d856', 'request_id': 'req-80fe693f-027a-4cd1-8219-821c5bfc8612'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.667323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-cf725759-4c52-4732-80e2-ab0a5ca222eb None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:36.668902 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cf725759-4c52-4732-80e2-ab0a5ca222eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:36.669870 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] The token cache is being invalidate because project f9f83908444d41f38d1ae81b8d70d856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:36.670347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.671182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.678019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 917/1827] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:36 2021] DELETE /identity/v3/projects/f9f83908444d41f38d1ae81b8d70d856 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:36.679398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:36.680903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:36.756881 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 911/1828] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:36.767456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf725759-4c52-4732-80e2-ab0a5ca222eb None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:36.769287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cf725759-4c52-4732-80e2-ab0a5ca222eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:36.792346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe693f-027a-4cd1-8219-821c5bfc8612 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:36.798942 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:36.799947 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:36.800297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:36.800692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] PATH_INFO: `/v3/users/59a93db0ab634952a9bf04b4852d6c4b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:36.802093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a93db0ab634952a9bf04b4852d6c4b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:36.830359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:36.847438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf725759-4c52-4732-80e2-ab0a5ca222eb None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:36.852291 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f6b6-66c4-4237-8183-ea39946f75d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:36.853461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f6b6-66c4-4237-8183-ea39946f75d9 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:36.853828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f6b6-66c4-4237-8183-ea39946f75d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:36.854222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f6b6-66c4-4237-8183-ea39946f75d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:36.867361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f6b6-66c4-4237-8183-ea39946f75d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:36.892385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a93db0ab634952a9bf04b4852d6c4b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.895158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f6b6-66c4-4237-8183-ea39946f75d9 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:36.905878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 912/1829] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:36.908818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a93db0ab634952a9bf04b4852d6c4b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.909586 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a93db0ab634952a9bf04b4852d6c4b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.928116 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a93db0ab634952a9bf04b4852d6c4b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.956544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b64ea428-f066-4aa5-b12d-f58d19af481f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a93db0ab634952a9bf04b4852d6c4b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:36.989376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 918/1830] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:36 2021] DELETE /identity/v3/users/59a93db0ab634952a9bf04b4852d6c4b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:37.457821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f6b6-66c4-4237-8183-ea39946f75d9 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:37.459321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0e32f6b6-66c4-4237-8183-ea39946f75d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:37.473674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f6b6-66c4-4237-8183-ea39946f75d9 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:37.547936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:37.548915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:37.549516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:37.549929 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] PATH_INFO: `/v3/projects/1c8c058d6b0941e2aa771815625aadd1` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:37.551224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8c058d6b0941e2aa771815625aadd1)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:37.597021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:37.666832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8c058d6b0941e2aa771815625aadd1', 'request_id': 'req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:37.683049 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8c058d6b0941e2aa771815625aadd1', 'request_id': 'req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:37.691734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8c058d6b0941e2aa771815625aadd1', 'request_id': 'req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:37.706361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] The token cache is being invalidate because project 1c8c058d6b0941e2aa771815625aadd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:37.707043 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:37.708220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6d5ef1ce-12dd-4e1d-91bb-428070147d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:37.710318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 913/1831] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:37 2021] DELETE /identity/v3/projects/1c8c058d6b0941e2aa771815625aadd1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:37.716107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc01324-628e-40e1-ba20-c3fcb124f74c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:37.716958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc01324-628e-40e1-ba20-c3fcb124f74c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:37.717256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc01324-628e-40e1-ba20-c3fcb124f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:37.749952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-dcc01324-628e-40e1-ba20-c3fcb124f74c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:37.751375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-dcc01324-628e-40e1-ba20-c3fcb124f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:37.840846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 919/1832] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:37.890932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25278b3-4b34-4b52-a2f9-ca0202853940 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:37.891391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25278b3-4b34-4b52-a2f9-ca0202853940 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:37.891666 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25278b3-4b34-4b52-a2f9-ca0202853940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:37.898449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc01324-628e-40e1-ba20-c3fcb124f74c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:37.900146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-dcc01324-628e-40e1-ba20-c3fcb124f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:37.913967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc01324-628e-40e1-ba20-c3fcb124f74c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:37.919923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:37.921869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e25278b3-4b34-4b52-a2f9-ca0202853940 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:37.922512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:37.923030 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:37.923478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] PATH_INFO: `/v3/projects/6132d08267c9412fb03ab74532ca5d57` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:37.923578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e25278b3-4b34-4b52-a2f9-ca0202853940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:37.924936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6132d08267c9412fb03ab74532ca5d57)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:37.932535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 914/1833] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:37.936483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25278b3-4b34-4b52-a2f9-ca0202853940 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:37.946295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25278b3-4b34-4b52-a2f9-ca0202853940 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:37.952230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290194-4cfe-4e1f-9401-74fe20014601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:37.953728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290194-4cfe-4e1f-9401-74fe20014601 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:37.954363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290194-4cfe-4e1f-9401-74fe20014601 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:37.954922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290194-4cfe-4e1f-9401-74fe20014601 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:37.955869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290194-4cfe-4e1f-9401-74fe20014601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:37.956430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:37.956539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290194-4cfe-4e1f-9401-74fe20014601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:37.984838 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290194-4cfe-4e1f-9401-74fe20014601 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.002906 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 915/1834] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:38.008310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290194-4cfe-4e1f-9401-74fe20014601 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.020505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290194-4cfe-4e1f-9401-74fe20014601 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.050142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6132d08267c9412fb03ab74532ca5d57', 'request_id': 'req-eea23952-f307-4247-94d4-a327c7f177fa'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:38.058135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6132d08267c9412fb03ab74532ca5d57', 'request_id': 'req-eea23952-f307-4247-94d4-a327c7f177fa'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:38.066656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6132d08267c9412fb03ab74532ca5d57', 'request_id': 'req-eea23952-f307-4247-94d4-a327c7f177fa'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:38.077164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] The token cache is being invalidate because project 6132d08267c9412fb03ab74532ca5d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:38.077458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:38.078183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-eea23952-f307-4247-94d4-a327c7f177fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:38.079755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 920/1835] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:37 2021] DELETE /identity/v3/projects/6132d08267c9412fb03ab74532ca5d57 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:38.086642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e09ed-e0c1-4181-87f0-30a2b1d0512d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.086945 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e09ed-e0c1-4181-87f0-30a2b1d0512d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.087233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e09ed-e0c1-4181-87f0-30a2b1d0512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.091819 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8915c-8853-4f3b-855f-6db2925c61a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.092447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8915c-8853-4f3b-855f-6db2925c61a7 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.092743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8915c-8853-4f3b-855f-6db2925c61a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.093032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8915c-8853-4f3b-855f-6db2925c61a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.093672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8915c-8853-4f3b-855f-6db2925c61a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.110384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-ed4e09ed-e0c1-4181-87f0-30a2b1d0512d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:38.111562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ed4e09ed-e0c1-4181-87f0-30a2b1d0512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:38.118921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 921/1836] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:38.120831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8915c-8853-4f3b-855f-6db2925c61a7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.127549 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab58461-d3a3-4c16-864f-dd03aab8f6ea None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.127843 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab58461-d3a3-4c16-864f-dd03aab8f6ea None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.128127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab58461-d3a3-4c16-864f-dd03aab8f6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.150670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 916/1837] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:38 2021] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:38.153348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8915c-8853-4f3b-855f-6db2925c61a7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.155054 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-33d8915c-8853-4f3b-855f-6db2925c61a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:38.155199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-9ab58461-d3a3-4c16-864f-dd03aab8f6ea None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:38.156275 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9ab58461-d3a3-4c16-864f-dd03aab8f6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:38.222998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 922/1838] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:38.225428 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8915c-8853-4f3b-855f-6db2925c61a7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.227486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab58461-d3a3-4c16-864f-dd03aab8f6ea None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.229845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c37ec7-3c60-4d8a-91eb-75303482faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.230445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c37ec7-3c60-4d8a-91eb-75303482faab admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.230762 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c37ec7-3c60-4d8a-91eb-75303482faab admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.231052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c37ec7-3c60-4d8a-91eb-75303482faab admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.231677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c37ec7-3c60-4d8a-91eb-75303482faab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.236266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab58461-d3a3-4c16-864f-dd03aab8f6ea None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.241286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69afff-c380-4f3e-a906-5c8dee525e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.241856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69afff-c380-4f3e-a906-5c8dee525e0c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.242146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69afff-c380-4f3e-a906-5c8dee525e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.242424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69afff-c380-4f3e-a906-5c8dee525e0c admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.243170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69afff-c380-4f3e-a906-5c8dee525e0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:38.243472 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69afff-c380-4f3e-a906-5c8dee525e0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.258076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c37ec7-3c60-4d8a-91eb-75303482faab admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.269387 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69afff-c380-4f3e-a906-5c8dee525e0c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.282421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 917/1839] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:38 2021] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:38.283544 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c37ec7-3c60-4d8a-91eb-75303482faab admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.284546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 923/1840] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:12:38.289095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69afff-c380-4f3e-a906-5c8dee525e0c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.295542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c37ec7-3c60-4d8a-91eb-75303482faab admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.298393 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69afff-c380-4f3e-a906-5c8dee525e0c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.299844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebe31e-2a29-4951-b6ba-c979e34d57c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.300435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebe31e-2a29-4951-b6ba-c979e34d57c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.300729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebe31e-2a29-4951-b6ba-c979e34d57c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.301014 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebe31e-2a29-4951-b6ba-c979e34d57c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.301710 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebe31e-2a29-4951-b6ba-c979e34d57c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.302594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf436e-3890-4838-816c-ede54f65b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.303207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf436e-3890-4838-816c-ede54f65b2fe admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.303490 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf436e-3890-4838-816c-ede54f65b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.303769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf436e-3890-4838-816c-ede54f65b2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.304391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf436e-3890-4838-816c-ede54f65b2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.328404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebe31e-2a29-4951-b6ba-c979e34d57c7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.330480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf436e-3890-4838-816c-ede54f65b2fe admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.339939 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 918/1841] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:38 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:38.345337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebe31e-2a29-4951-b6ba-c979e34d57c7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.356667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebe31e-2a29-4951-b6ba-c979e34d57c7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.361340 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a55673-9aaa-42ab-af60-56eaad010edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.362427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a55673-9aaa-42ab-af60-56eaad010edc admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.362758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a55673-9aaa-42ab-af60-56eaad010edc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.363051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a55673-9aaa-42ab-af60-56eaad010edc admin admin] PATH_INFO: `/v3/projects/60e82d66a2d1455cacfc28bedb19b56e/users/592713d31f9a4945aae03e37a9853225/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.369168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 924/1842] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:38 2021] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:38.370466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf436e-3890-4838-816c-ede54f65b2fe admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.385931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a55673-9aaa-42ab-af60-56eaad010edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e82d66a2d1455cacfc28bedb19b56e, user_id=592713d31f9a4945aae03e37a9853225, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.414657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a55673-9aaa-42ab-af60-56eaad010edc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.429893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 919/1843] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:38 2021] PUT /identity/v3/projects/60e82d66a2d1455cacfc28bedb19b56e/users/592713d31f9a4945aae03e37a9853225/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:38.440103 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61397c2d-c539-4a36-8265-6cb4bdedf32a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.440401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61397c2d-c539-4a36-8265-6cb4bdedf32a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.440692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61397c2d-c539-4a36-8265-6cb4bdedf32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.457291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf436e-3890-4838-816c-ede54f65b2fe admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.488165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-61397c2d-c539-4a36-8265-6cb4bdedf32a None None] MFA Rules not processed for user `592713d31f9a4945aae03e37a9853225`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:38.489359 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-61397c2d-c539-4a36-8265-6cb4bdedf32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:38.555306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc4a49-e582-4a3e-94ee-5ae5600d63fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.556217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc4a49-e582-4a3e-94ee-5ae5600d63fc admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.556787 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc4a49-e582-4a3e-94ee-5ae5600d63fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.557254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc4a49-e582-4a3e-94ee-5ae5600d63fc admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.558657 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc4a49-e582-4a3e-94ee-5ae5600d63fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.586063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 920/1844] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:38 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:38.589858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc4a49-e582-4a3e-94ee-5ae5600d63fc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.594558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61397c2d-c539-4a36-8265-6cb4bdedf32a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.595915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-61397c2d-c539-4a36-8265-6cb4bdedf32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:38.644641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 925/1845] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:38 2021] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:38.649835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc4a49-e582-4a3e-94ee-5ae5600d63fc admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.664589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc4a49-e582-4a3e-94ee-5ae5600d63fc admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.682501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56372f5-7044-4aa3-b1a6-d5f1afa531ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.683366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56372f5-7044-4aa3-b1a6-d5f1afa531ce admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.683791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56372f5-7044-4aa3-b1a6-d5f1afa531ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.684232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56372f5-7044-4aa3-b1a6-d5f1afa531ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.685063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56372f5-7044-4aa3-b1a6-d5f1afa531ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.716571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56372f5-7044-4aa3-b1a6-d5f1afa531ce admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.729967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 926/1846] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:38 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:38.734286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56372f5-7044-4aa3-b1a6-d5f1afa531ce admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:38.741356 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61397c2d-c539-4a36-8265-6cb4bdedf32a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.746110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56372f5-7044-4aa3-b1a6-d5f1afa531ce admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:38.746903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df17aae-f277-4f71-8a14-1451c61c1598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.747497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df17aae-f277-4f71-8a14-1451c61c1598 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.747785 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df17aae-f277-4f71-8a14-1451c61c1598 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.748066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df17aae-f277-4f71-8a14-1451c61c1598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.750669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e950b6-d7d6-4447-84b8-0953375c9e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:38.751514 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e950b6-d7d6-4447-84b8-0953375c9e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.751809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e950b6-d7d6-4447-84b8-0953375c9e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.752238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e950b6-d7d6-4447-84b8-0953375c9e2d admin admin] PATH_INFO: `/v3/projects/ad70fb1a39324fb68715ca84ad65f4c1/users/b511e68bf2d041bbbcb0febe2333baa7/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.757678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df17aae-f277-4f71-8a14-1451c61c1598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.774102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e950b6-d7d6-4447-84b8-0953375c9e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad70fb1a39324fb68715ca84ad65f4c1, user_id=b511e68bf2d041bbbcb0febe2333baa7, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:38.788499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df17aae-f277-4f71-8a14-1451c61c1598 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.798931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 921/1847] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:38 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:38.801672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e950b6-d7d6-4447-84b8-0953375c9e2d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:38.821949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 927/1848] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:38 2021] PUT /identity/v3/projects/ad70fb1a39324fb68715ca84ad65f4c1/users/b511e68bf2d041bbbcb0febe2333baa7/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:38.832060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fccec-3917-4a01-9ab3-1eda9b5884bf None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:38.832358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fccec-3917-4a01-9ab3-1eda9b5884bf None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:38.832663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fccec-3917-4a01-9ab3-1eda9b5884bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:38.916580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-4d0fccec-3917-4a01-9ab3-1eda9b5884bf None None] MFA Rules not processed for user `b511e68bf2d041bbbcb0febe2333baa7`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:38.920005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4d0fccec-3917-4a01-9ab3-1eda9b5884bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:39.075280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 922/1849] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:38 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:39.113618 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e950b6-d7d6-4447-84b8-0953375c9e2d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:39.116348 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d8e950b6-d7d6-4447-84b8-0953375c9e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:39.198617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e950b6-d7d6-4447-84b8-0953375c9e2d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:39.202270 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727ee09-a0bc-4007-a481-d4b51bc8f770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:39.202901 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727ee09-a0bc-4007-a481-d4b51bc8f770 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:39.203194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727ee09-a0bc-4007-a481-d4b51bc8f770 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:39.203487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727ee09-a0bc-4007-a481-d4b51bc8f770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:39.213355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727ee09-a0bc-4007-a481-d4b51bc8f770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:39.239171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727ee09-a0bc-4007-a481-d4b51bc8f770 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:39.249040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 928/1850] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:39 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:39.270477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fccec-3917-4a01-9ab3-1eda9b5884bf None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:39.361508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fccec-3917-4a01-9ab3-1eda9b5884bf None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:39.367142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:39.367957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:39.368252 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:39.368536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] PATH_INFO: `/v3/users/b511e68bf2d041bbbcb0febe2333baa7` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:39.369698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b511e68bf2d041bbbcb0febe2333baa7)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:39.404237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:39.479038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b511e68bf2d041bbbcb0febe2333baa7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.498555 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b511e68bf2d041bbbcb0febe2333baa7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.500440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b511e68bf2d041bbbcb0febe2333baa7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.510369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b511e68bf2d041bbbcb0febe2333baa7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.520550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b511e68bf2d041bbbcb0febe2333baa7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.528614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 923/1851] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:39 2021] DELETE /identity/v3/users/b511e68bf2d041bbbcb0febe2333baa7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:39.533528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8908-b37b-4769-a5a5-5812e95ce915 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:39.533988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8908-b37b-4769-a5a5-5812e95ce915 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:39.534540 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8908-b37b-4769-a5a5-5812e95ce915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:39.577706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-5fcc8908-b37b-4769-a5a5-5812e95ce915 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:39.579051 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5fcc8908-b37b-4769-a5a5-5812e95ce915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:39.663357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:39.664788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:39.665013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 929/1852] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:39.675003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8908-b37b-4769-a5a5-5812e95ce915 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:39.676279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5fcc8908-b37b-4769-a5a5-5812e95ce915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:39.678570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495655c-fd73-49ce-adee-b71647bc5d6f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:39.682800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:39.683607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:39.683965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:39.684254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] PATH_INFO: `/v3/users/592713d31f9a4945aae03e37a9853225` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:39.685346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=592713d31f9a4945aae03e37a9853225)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:39.711025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:39.740573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8908-b37b-4769-a5a5-5812e95ce915 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:39.744598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1cbe1-a325-4fb2-914d-763e2f3ecc63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:39.745367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1cbe1-a325-4fb2-914d-763e2f3ecc63 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:39.745700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1cbe1-a325-4fb2-914d-763e2f3ecc63 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:39.745988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1cbe1-a325-4fb2-914d-763e2f3ecc63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:39.755503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1cbe1-a325-4fb2-914d-763e2f3ecc63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:39.763332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592713d31f9a4945aae03e37a9853225'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.774830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592713d31f9a4945aae03e37a9853225'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.775561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592713d31f9a4945aae03e37a9853225'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.780666 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1cbe1-a325-4fb2-914d-763e2f3ecc63 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:39.783030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592713d31f9a4945aae03e37a9853225'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.790699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592713d31f9a4945aae03e37a9853225'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:39.791131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 930/1853] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:39.796644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 924/1854] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:39 2021] DELETE /identity/v3/users/592713d31f9a4945aae03e37a9853225 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:39.801101 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1fa8-c5f1-4a06-a786-02591f301b0c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:39.801407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1fa8-c5f1-4a06-a786-02591f301b0c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:39.801698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1fa8-c5f1-4a06-a786-02591f301b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:39.825637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-986c1fa8-c5f1-4a06-a786-02591f301b0c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:39.826998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-986c1fa8-c5f1-4a06-a786-02591f301b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:39.898445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 931/1855] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:39.908717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:39.910030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:39.976272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c0c5a-33fa-4af0-8ace-8df0ba60d09c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:39.983697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d8490-0bb0-4920-8493-0dde3c3e7eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:39.984323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d8490-0bb0-4920-8493-0dde3c3e7eef service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:39.984616 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d8490-0bb0-4920-8493-0dde3c3e7eef service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:39.984909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d8490-0bb0-4920-8493-0dde3c3e7eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:39.997001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d8490-0bb0-4920-8493-0dde3c3e7eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:40.024278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d8490-0bb0-4920-8493-0dde3c3e7eef service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:40.034754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 925/1856] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:40.171658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1fa8-c5f1-4a06-a786-02591f301b0c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:40.175544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-986c1fa8-c5f1-4a06-a786-02591f301b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:40.190281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1fa8-c5f1-4a06-a786-02591f301b0c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:40.198018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:40.199354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:40.199783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:40.200127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] PATH_INFO: `/v3/projects/ad70fb1a39324fb68715ca84ad65f4c1` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:40.202019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad70fb1a39324fb68715ca84ad65f4c1)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:40.231847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:40.291238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad70fb1a39324fb68715ca84ad65f4c1', 'request_id': 'req-6153212f-a3fb-49b4-a1a6-ff151b01838a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.302578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad70fb1a39324fb68715ca84ad65f4c1', 'request_id': 'req-6153212f-a3fb-49b4-a1a6-ff151b01838a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.312828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad70fb1a39324fb68715ca84ad65f4c1', 'request_id': 'req-6153212f-a3fb-49b4-a1a6-ff151b01838a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.334748 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] The token cache is being invalidate because project ad70fb1a39324fb68715ca84ad65f4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:40.334933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.335611 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6153212f-a3fb-49b4-a1a6-ff151b01838a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.338069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 932/1857] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:40 2021] DELETE /identity/v3/projects/ad70fb1a39324fb68715ca84ad65f4c1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:40.343879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f3bdf-5689-41f3-a912-07bc4bec8e31 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:40.344186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f3bdf-5689-41f3-a912-07bc4bec8e31 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:40.344478 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f3bdf-5689-41f3-a912-07bc4bec8e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:40.373263 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c88f3bdf-5689-41f3-a912-07bc4bec8e31 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:40.375268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c88f3bdf-5689-41f3-a912-07bc4bec8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:40.491366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 926/1858] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:40.504096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c180e27-0a75-4678-b414-d78bdd7a5e72 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:40.504096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c180e27-0a75-4678-b414-d78bdd7a5e72 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:40.504357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c180e27-0a75-4678-b414-d78bdd7a5e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:40.530709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6c180e27-0a75-4678-b414-d78bdd7a5e72 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:40.532127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6c180e27-0a75-4678-b414-d78bdd7a5e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:40.550920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f3bdf-5689-41f3-a912-07bc4bec8e31 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:40.557484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 933/1859] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:40.558434 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c180e27-0a75-4678-b414-d78bdd7a5e72 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:40.563239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f3bdf-5689-41f3-a912-07bc4bec8e31 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:40.564230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6c180e27-0a75-4678-b414-d78bdd7a5e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:40.574246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e368f13-266a-4774-bdb1-8e7fc99fc77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:40.574908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e368f13-266a-4774-bdb1-8e7fc99fc77f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:40.575196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e368f13-266a-4774-bdb1-8e7fc99fc77f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:40.575540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e368f13-266a-4774-bdb1-8e7fc99fc77f admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:40.576562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e368f13-266a-4774-bdb1-8e7fc99fc77f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:40.576878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e368f13-266a-4774-bdb1-8e7fc99fc77f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:40.580667 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c180e27-0a75-4678-b414-d78bdd7a5e72 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:40.586103 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:40.587179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:40.587804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:40.588926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] PATH_INFO: `/v3/projects/60e82d66a2d1455cacfc28bedb19b56e` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:40.590277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e82d66a2d1455cacfc28bedb19b56e)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:40.606597 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e368f13-266a-4774-bdb1-8e7fc99fc77f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:40.629196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:40.641531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 927/1860] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:40.646445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e368f13-266a-4774-bdb1-8e7fc99fc77f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:40.665868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e368f13-266a-4774-bdb1-8e7fc99fc77f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:40.677638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c2ea2-7027-4465-a6b2-9a290c7325cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:40.678256 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c2ea2-7027-4465-a6b2-9a290c7325cc admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:40.678538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c2ea2-7027-4465-a6b2-9a290c7325cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:40.678835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c2ea2-7027-4465-a6b2-9a290c7325cc admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:40.679478 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c2ea2-7027-4465-a6b2-9a290c7325cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:40.720386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e82d66a2d1455cacfc28bedb19b56e', 'request_id': 'req-436240b8-8833-447e-b0e9-603c81436b71'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.737972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c2ea2-7027-4465-a6b2-9a290c7325cc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:40.759103 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e82d66a2d1455cacfc28bedb19b56e', 'request_id': 'req-436240b8-8833-447e-b0e9-603c81436b71'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.772968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e82d66a2d1455cacfc28bedb19b56e', 'request_id': 'req-436240b8-8833-447e-b0e9-603c81436b71'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.801342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] The token cache is being invalidate because project 60e82d66a2d1455cacfc28bedb19b56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:40.805849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.806970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-436240b8-8833-447e-b0e9-603c81436b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:40.808505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 934/1861] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:40 2021] DELETE /identity/v3/projects/60e82d66a2d1455cacfc28bedb19b56e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:40.814943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc869fb-7afa-417a-a305-041d52de3b5c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:40.815433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc869fb-7afa-417a-a305-041d52de3b5c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:40.816245 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc869fb-7afa-417a-a305-041d52de3b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:40.816966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 928/1862] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:40 2021] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:40.821673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c2ea2-7027-4465-a6b2-9a290c7325cc admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:40.823445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6a7c2ea2-7027-4465-a6b2-9a290c7325cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:40.849456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7bc869fb-7afa-417a-a305-041d52de3b5c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:40.850990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7bc869fb-7afa-417a-a305-041d52de3b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:40.934674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c2ea2-7027-4465-a6b2-9a290c7325cc admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:40.944519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854146e-9bbf-4bc7-9b8e-7006b2f1bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:40.945244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854146e-9bbf-4bc7-9b8e-7006b2f1bb02 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:40.945529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854146e-9bbf-4bc7-9b8e-7006b2f1bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:40.945993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854146e-9bbf-4bc7-9b8e-7006b2f1bb02 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:40.946935 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854146e-9bbf-4bc7-9b8e-7006b2f1bb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.002244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854146e-9bbf-4bc7-9b8e-7006b2f1bb02 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.005084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 935/1863] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:41.014292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24712c-7f1e-4217-94da-429259d1c10e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.014604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24712c-7f1e-4217-94da-429259d1c10e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.014910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24712c-7f1e-4217-94da-429259d1c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.039427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-df24712c-7f1e-4217-94da-429259d1c10e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:41.040584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-df24712c-7f1e-4217-94da-429259d1c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:41.054661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 936/1864] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:41.055631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24712c-7f1e-4217-94da-429259d1c10e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.059920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 929/1865] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:40 2021] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:41.063990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854146e-9bbf-4bc7-9b8e-7006b2f1bb02 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.075116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854146e-9bbf-4bc7-9b8e-7006b2f1bb02 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:41.075424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24712c-7f1e-4217-94da-429259d1c10e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:41.080048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89995-f09e-460a-b7c3-459b8a791391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:41.080726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89995-f09e-460a-b7c3-459b8a791391 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.081087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89995-f09e-460a-b7c3-459b8a791391 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.081278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4740d9-f691-48e4-bae5-a551ddf3fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:41.081497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89995-f09e-460a-b7c3-459b8a791391 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.082461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89995-f09e-460a-b7c3-459b8a791391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.083897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4740d9-f691-48e4-bae5-a551ddf3fc68 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.085160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4740d9-f691-48e4-bae5-a551ddf3fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.085463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4740d9-f691-48e4-bae5-a551ddf3fc68 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.086820 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4740d9-f691-48e4-bae5-a551ddf3fc68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:41.087371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4740d9-f691-48e4-bae5-a551ddf3fc68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.118308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89995-f09e-460a-b7c3-459b8a791391 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.132344 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 930/1866] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:41 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:41.135163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4740d9-f691-48e4-bae5-a551ddf3fc68 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.137574 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89995-f09e-460a-b7c3-459b8a791391 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.159254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89995-f09e-460a-b7c3-459b8a791391 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:41.162957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 937/1867] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:41.170208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4740d9-f691-48e4-bae5-a551ddf3fc68 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.175379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7790770-b4a3-4b38-af23-d8ebc466d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:41.176556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7790770-b4a3-4b38-af23-d8ebc466d281 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.177137 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7790770-b4a3-4b38-af23-d8ebc466d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.177652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7790770-b4a3-4b38-af23-d8ebc466d281 admin admin] PATH_INFO: `/v3/projects/f4cf552b45d4479e8479d0cdb32c091f/users/f151c1625966448caf702ebbc863423a/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.184889 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4740d9-f691-48e4-bae5-a551ddf3fc68 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:41.191386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296b5da-7f88-4aee-9d48-1b6e9b8aa58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:41.193287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296b5da-7f88-4aee-9d48-1b6e9b8aa58c admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.193824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296b5da-7f88-4aee-9d48-1b6e9b8aa58c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.194285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296b5da-7f88-4aee-9d48-1b6e9b8aa58c admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.195133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296b5da-7f88-4aee-9d48-1b6e9b8aa58c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.207369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7790770-b4a3-4b38-af23-d8ebc466d281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cf552b45d4479e8479d0cdb32c091f, user_id=f151c1625966448caf702ebbc863423a, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.229062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296b5da-7f88-4aee-9d48-1b6e9b8aa58c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.247272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7790770-b4a3-4b38-af23-d8ebc466d281 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.270001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 931/1868] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:41 2021] PUT /identity/v3/projects/f4cf552b45d4479e8479d0cdb32c091f/users/f151c1625966448caf702ebbc863423a/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:41.276605 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 938/1869] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:41 2021] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:41.281840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7790770-b4a3-4b38-af23-d8ebc466d281 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.283598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025fec1-d303-49ba-9e32-a0e65b23979e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.283900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025fec1-d303-49ba-9e32-a0e65b23979e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.284186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025fec1-d303-49ba-9e32-a0e65b23979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.364092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0025fec1-d303-49ba-9e32-a0e65b23979e None None] MFA Rules not processed for user `f151c1625966448caf702ebbc863423a`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:41.365263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0025fec1-d303-49ba-9e32-a0e65b23979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:41.442303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7790770-b4a3-4b38-af23-d8ebc466d281 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:41.522436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 939/1870] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:41 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:41.528900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025fec1-d303-49ba-9e32-a0e65b23979e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.531381 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0025fec1-d303-49ba-9e32-a0e65b23979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:41.541136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5265e3-8ae9-483e-a7e6-e77bbe506741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:41.541689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5265e3-8ae9-483e-a7e6-e77bbe506741 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.541981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5265e3-8ae9-483e-a7e6-e77bbe506741 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.542273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5265e3-8ae9-483e-a7e6-e77bbe506741 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.543163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5265e3-8ae9-483e-a7e6-e77bbe506741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.572057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5265e3-8ae9-483e-a7e6-e77bbe506741 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.596589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 932/1871] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:41 2021] POST /identity/v3/users => generated 282 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:41.597782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5265e3-8ae9-483e-a7e6-e77bbe506741 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.607835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5265e3-8ae9-483e-a7e6-e77bbe506741 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:41.612484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab034-4a1f-4e0f-8ec0-a1e38bbc66d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:41.613087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab034-4a1f-4e0f-8ec0-a1e38bbc66d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.613385 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab034-4a1f-4e0f-8ec0-a1e38bbc66d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.613673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab034-4a1f-4e0f-8ec0-a1e38bbc66d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.614922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ab034-4a1f-4e0f-8ec0-a1e38bbc66d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.617823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025fec1-d303-49ba-9e32-a0e65b23979e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:41.621801 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ee5a-65dc-4c58-a675-3d357355b86e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:41.622849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ee5a-65dc-4c58-a675-3d357355b86e service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.623358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ee5a-65dc-4c58-a675-3d357355b86e service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.623841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ee5a-65dc-4c58-a675-3d357355b86e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.634583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7ee5a-65dc-4c58-a675-3d357355b86e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.641026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ab034-4a1f-4e0f-8ec0-a1e38bbc66d7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.653721 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 933/1872] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:41 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:41.658033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab034-4a1f-4e0f-8ec0-a1e38bbc66d7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.665699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7ee5a-65dc-4c58-a675-3d357355b86e service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.671528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab034-4a1f-4e0f-8ec0-a1e38bbc66d7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:41.677980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91237aff-8f21-47a9-b863-a06f4f17ef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:41.679219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91237aff-8f21-47a9-b863-a06f4f17ef45 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.679622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91237aff-8f21-47a9-b863-a06f4f17ef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.680074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91237aff-8f21-47a9-b863-a06f4f17ef45 admin admin] PATH_INFO: `/v3/projects/69110ac6db89416495b1c019d6c8580b/users/3526c5f7784a41eb904260a4e8588e08/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.696590 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 940/1873] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:41 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:41.698349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ee5a-65dc-4c58-a675-3d357355b86e service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.710697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ee5a-65dc-4c58-a675-3d357355b86e service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:41.716000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:41.717001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.717291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.717573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] PATH_INFO: `/v3/users/f151c1625966448caf702ebbc863423a` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.718774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f151c1625966448caf702ebbc863423a)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.721021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91237aff-8f21-47a9-b863-a06f4f17ef45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69110ac6db89416495b1c019d6c8580b, user_id=3526c5f7784a41eb904260a4e8588e08, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:41.754900 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91237aff-8f21-47a9-b863-a06f4f17ef45 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.763054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:41.780031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 934/1874] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:41 2021] PUT /identity/v3/projects/69110ac6db89416495b1c019d6c8580b/users/3526c5f7784a41eb904260a4e8588e08/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:41.796119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd03453-44bd-4cd6-a589-75822437325c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.796498 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd03453-44bd-4cd6-a589-75822437325c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.797205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd03453-44bd-4cd6-a589-75822437325c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.848510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-4fd03453-44bd-4cd6-a589-75822437325c None None] MFA Rules not processed for user `3526c5f7784a41eb904260a4e8588e08`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:41.850364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4fd03453-44bd-4cd6-a589-75822437325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:41.853367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f151c1625966448caf702ebbc863423a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:41.891385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f151c1625966448caf702ebbc863423a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:41.892126 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f151c1625966448caf702ebbc863423a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:41.910405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f151c1625966448caf702ebbc863423a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:41.929269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-6cd8c4c6-470c-498a-8389-b6ba8dfcb9bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f151c1625966448caf702ebbc863423a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:41.945216 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 941/1875] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:41 2021] DELETE /identity/v3/users/f151c1625966448caf702ebbc863423a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:41.947484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc92359-0d81-4aa8-976b-52320a61f5f2 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:41.947783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc92359-0d81-4aa8-976b-52320a61f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:41.948062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc92359-0d81-4aa8-976b-52320a61f5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:41.993725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 935/1876] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:41 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:41.994874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd03453-44bd-4cd6-a589-75822437325c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:41.996636 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4fd03453-44bd-4cd6-a589-75822437325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:41.998284 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-fcc92359-0d81-4aa8-976b-52320a61f5f2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:42.017496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fcc92359-0d81-4aa8-976b-52320a61f5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:42.096245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd03453-44bd-4cd6-a589-75822437325c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:42.183922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841ebaf-8fca-47d3-b454-81dec9684741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:42.184040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841ebaf-8fca-47d3-b454-81dec9684741 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:42.184273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841ebaf-8fca-47d3-b454-81dec9684741 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:42.184560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841ebaf-8fca-47d3-b454-81dec9684741 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:42.185580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841ebaf-8fca-47d3-b454-81dec9684741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:42.216244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841ebaf-8fca-47d3-b454-81dec9684741 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:42.254369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 942/1877] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:42.267077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc92359-0d81-4aa8-976b-52320a61f5f2 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:42.275377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 936/1878] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:41 2021] POST /identity/v3/projects => generated 363 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:42.276508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841ebaf-8fca-47d3-b454-81dec9684741 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:42.277201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fcc92359-0d81-4aa8-976b-52320a61f5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:42.372998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841ebaf-8fca-47d3-b454-81dec9684741 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:42.385359 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb746d-1583-43cf-8580-096cdc1d3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:42.386130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb746d-1583-43cf-8580-096cdc1d3128 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:42.386563 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb746d-1583-43cf-8580-096cdc1d3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:42.387050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb746d-1583-43cf-8580-096cdc1d3128 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:42.387868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb746d-1583-43cf-8580-096cdc1d3128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:42.422403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb746d-1583-43cf-8580-096cdc1d3128 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:42.438603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc92359-0d81-4aa8-976b-52320a61f5f2 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:42.456584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 937/1879] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:42 2021] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:42.462018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb746d-1583-43cf-8580-096cdc1d3128 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:42.475395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb746d-1583-43cf-8580-096cdc1d3128 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:42.482077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e29c1c-ba4d-466c-aef9-99e5f519177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:42.482733 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e29c1c-ba4d-466c-aef9-99e5f519177a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:42.483025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e29c1c-ba4d-466c-aef9-99e5f519177a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:42.483324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e29c1c-ba4d-466c-aef9-99e5f519177a admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:42.483982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e29c1c-ba4d-466c-aef9-99e5f519177a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:42.514668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e29c1c-ba4d-466c-aef9-99e5f519177a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:42.537457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 938/1880] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:42 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:42.538814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e29c1c-ba4d-466c-aef9-99e5f519177a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:42.540935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9399d-c5a2-4a90-a10f-6179394f223e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:42.541647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9399d-c5a2-4a90-a10f-6179394f223e service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:42.542041 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9399d-c5a2-4a90-a10f-6179394f223e service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:42.542428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9399d-c5a2-4a90-a10f-6179394f223e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:42.551192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e29c1c-ba4d-466c-aef9-99e5f519177a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:42.553321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9399d-c5a2-4a90-a10f-6179394f223e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:42.559720 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee594d3-a072-4497-bff9-810ef76320e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:42.560551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee594d3-a072-4497-bff9-810ef76320e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:42.560840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee594d3-a072-4497-bff9-810ef76320e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:42.561122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee594d3-a072-4497-bff9-810ef76320e3 admin admin] PATH_INFO: `/v3/projects/3d19ae7d1f8e4f56ba2ec8cf53531819/users/1977fcce862e49158079a9d0712d5c76/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:42.584398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9399d-c5a2-4a90-a10f-6179394f223e service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:42.601574 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 943/1881] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:42.621504 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee594d3-a072-4497-bff9-810ef76320e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d19ae7d1f8e4f56ba2ec8cf53531819, user_id=1977fcce862e49158079a9d0712d5c76, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:42.654038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee594d3-a072-4497-bff9-810ef76320e3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:42.675684 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 939/1882] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:42 2021] PUT /identity/v3/projects/3d19ae7d1f8e4f56ba2ec8cf53531819/users/1977fcce862e49158079a9d0712d5c76/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:42.679989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9399d-c5a2-4a90-a10f-6179394f223e service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:42.694058 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9399d-c5a2-4a90-a10f-6179394f223e service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:42.789168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31441ad6-90c8-4e7c-a946-d9cac721d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:42.789863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31441ad6-90c8-4e7c-a946-d9cac721d616 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:42.790657 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31441ad6-90c8-4e7c-a946-d9cac721d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:42.790957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31441ad6-90c8-4e7c-a946-d9cac721d616 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:42.791740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31441ad6-90c8-4e7c-a946-d9cac721d616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:42.821530 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31441ad6-90c8-4e7c-a946-d9cac721d616 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:42.837102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee594d3-a072-4497-bff9-810ef76320e3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:42.838915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-dee594d3-a072-4497-bff9-810ef76320e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:42.845679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 944/1883] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:42 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:42.856384 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee594d3-a072-4497-bff9-810ef76320e3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:42.859595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31441ad6-90c8-4e7c-a946-d9cac721d616 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:42.872495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:42.873929 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:42.874445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:42.874964 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] PATH_INFO: `/v3/users/81dca00d11db4388b7a82c00a989bbf7` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:42.876362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dca00d11db4388b7a82c00a989bbf7)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:42.889235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31441ad6-90c8-4e7c-a946-d9cac721d616 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:42.932949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:42.947880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0582d-3ea2-45f9-8515-5aa843f9603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:42.947880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0582d-3ea2-45f9-8515-5aa843f9603a admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:42.947880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0582d-3ea2-45f9-8515-5aa843f9603a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:42.947880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0582d-3ea2-45f9-8515-5aa843f9603a admin admin] PATH_INFO: `/v3/projects/3d19ae7d1f8e4f56ba2ec8cf53531819/users/1977fcce862e49158079a9d0712d5c76/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:42.954376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0582d-3ea2-45f9-8515-5aa843f9603a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d19ae7d1f8e4f56ba2ec8cf53531819, user_id=1977fcce862e49158079a9d0712d5c76, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:42.978647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0582d-3ea2-45f9-8515-5aa843f9603a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:42.998804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 945/1884] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:42 2021] PUT /identity/v3/projects/3d19ae7d1f8e4f56ba2ec8cf53531819/users/1977fcce862e49158079a9d0712d5c76/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:43.004032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0582d-3ea2-45f9-8515-5aa843f9603a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:43.114865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dca00d11db4388b7a82c00a989bbf7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.139234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dca00d11db4388b7a82c00a989bbf7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.140825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dca00d11db4388b7a82c00a989bbf7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.160336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0582d-3ea2-45f9-8515-5aa843f9603a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:43.162556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dca00d11db4388b7a82c00a989bbf7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.171723 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc89f-616e-415c-ac9a-76171359cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:43.172971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc89f-616e-415c-ac9a-76171359cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:43.173351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc89f-616e-415c-ac9a-76171359cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:43.174068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc89f-616e-415c-ac9a-76171359cd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:43.175063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc89f-616e-415c-ac9a-76171359cd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:43.178291 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-1688327e-24e9-49d6-88c9-256a7e4cc1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dca00d11db4388b7a82c00a989bbf7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.196967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 940/1885] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:42 2021] DELETE /identity/v3/users/81dca00d11db4388b7a82c00a989bbf7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:43.198449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2177c4f-95ef-4f2e-bca3-310c50b05a90 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:43.198775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2177c4f-95ef-4f2e-bca3-310c50b05a90 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:43.199061 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2177c4f-95ef-4f2e-bca3-310c50b05a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:43.240170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc89f-616e-415c-ac9a-76171359cd79 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:43.244258 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e2177c4f-95ef-4f2e-bca3-310c50b05a90 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:43.248000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e2177c4f-95ef-4f2e-bca3-310c50b05a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:43.282783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 946/1886] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:43 2021] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:43.284077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc89f-616e-415c-ac9a-76171359cd79 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:43.291685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-825bc89f-616e-415c-ac9a-76171359cd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:43.315100 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc89f-616e-415c-ac9a-76171359cd79 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:43.367995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 941/1887] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:43.384810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2177c4f-95ef-4f2e-bca3-310c50b05a90 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:43.386144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e2177c4f-95ef-4f2e-bca3-310c50b05a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:43.409509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac005076-960e-4292-9926-bc0102b11a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:43.410713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac005076-960e-4292-9926-bc0102b11a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:43.411388 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac005076-960e-4292-9926-bc0102b11a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:43.411881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac005076-960e-4292-9926-bc0102b11a5b admin admin] PATH_INFO: `/v3/projects/3d19ae7d1f8e4f56ba2ec8cf53531819/users/1977fcce862e49158079a9d0712d5c76/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:43.414954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac005076-960e-4292-9926-bc0102b11a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d19ae7d1f8e4f56ba2ec8cf53531819, user_id=1977fcce862e49158079a9d0712d5c76, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:43.447095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac005076-960e-4292-9926-bc0102b11a5b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:43.461805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 947/1888] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:43 2021] PUT /identity/v3/projects/3d19ae7d1f8e4f56ba2ec8cf53531819/users/1977fcce862e49158079a9d0712d5c76/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:43.472461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2177c4f-95ef-4f2e-bca3-310c50b05a90 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:43.472727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be88dec-7d6f-482a-b667-70f728dfae2c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:43.472950 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be88dec-7d6f-482a-b667-70f728dfae2c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:43.473216 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be88dec-7d6f-482a-b667-70f728dfae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:43.528819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3be88dec-7d6f-482a-b667-70f728dfae2c None None] MFA Rules not processed for user `1977fcce862e49158079a9d0712d5c76`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:43.529986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3be88dec-7d6f-482a-b667-70f728dfae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:43.559506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d5ea5-dc31-4983-b473-cff2292709f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:43.560086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d5ea5-dc31-4983-b473-cff2292709f9 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:43.560379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d5ea5-dc31-4983-b473-cff2292709f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:43.560694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d5ea5-dc31-4983-b473-cff2292709f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:43.611655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 948/1889] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:43 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:43.612777 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be88dec-7d6f-482a-b667-70f728dfae2c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:43.614214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3be88dec-7d6f-482a-b667-70f728dfae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:43.644794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d5ea5-dc31-4983-b473-cff2292709f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:43.672395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d5ea5-dc31-4983-b473-cff2292709f9 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:43.683348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 942/1890] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:43.688926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be88dec-7d6f-482a-b667-70f728dfae2c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:43.690121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d5ea5-dc31-4983-b473-cff2292709f9 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:43.691789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e11d5ea5-dc31-4983-b473-cff2292709f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:43.694947 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:43.695913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:43.696355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:43.696756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] PATH_INFO: `/v3/projects/f4cf552b45d4479e8479d0cdb32c091f` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:43.698277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cf552b45d4479e8479d0cdb32c091f)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:43.729845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:43.773009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d5ea5-dc31-4983-b473-cff2292709f9 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:43.778105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d8416-7bc1-4881-a03b-80166672d695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:43.779105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8416-7bc1-4881-a03b-80166672d695 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:43.779685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8416-7bc1-4881-a03b-80166672d695 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:43.780484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8416-7bc1-4881-a03b-80166672d695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:43.793232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d8416-7bc1-4881-a03b-80166672d695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:43.800766 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cf552b45d4479e8479d0cdb32c091f', 'request_id': 'req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.815826 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cf552b45d4479e8479d0cdb32c091f', 'request_id': 'req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.826961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cf552b45d4479e8479d0cdb32c091f', 'request_id': 'req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.830361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d8416-7bc1-4881-a03b-80166672d695 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:43.841255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] The token cache is being invalidate because project f4cf552b45d4479e8479d0cdb32c091f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:43.841631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.842378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:43.843082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 943/1891] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:43 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:43.844207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 949/1892] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:43 2021] DELETE /identity/v3/projects/f4cf552b45d4479e8479d0cdb32c091f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:43.857659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7b63e-9c3a-4689-862b-ba6112aa4aaf None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:43.858233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7b63e-9c3a-4689-862b-ba6112aa4aaf None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:43.859783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7b63e-9c3a-4689-862b-ba6112aa4aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:43.894477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-efb7b63e-9c3a-4689-862b-ba6112aa4aaf None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:43.897872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-efb7b63e-9c3a-4689-862b-ba6112aa4aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.039367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:44.041221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.048452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 944/1893] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:44.050106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f26e-cab3-4766-956a-ff25f2eeb34a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.050466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f26e-cab3-4766-956a-ff25f2eeb34a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.050782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f26e-cab3-4766-956a-ff25f2eeb34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.063998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446159d-4bf4-4228-a3f9-6bc74b1a6d66 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:44.070045 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:44.071460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.071976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.072516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] PATH_INFO: `/v3/users/3526c5f7784a41eb904260a4e8588e08` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.073893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3526c5f7784a41eb904260a4e8588e08)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:44.076726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-cf34f26e-cab3-4766-956a-ff25f2eeb34a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:44.077889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cf34f26e-cab3-4766-956a-ff25f2eeb34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.086763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 945/1894] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:44.090859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f26e-cab3-4766-956a-ff25f2eeb34a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:44.101667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f26e-cab3-4766-956a-ff25f2eeb34a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:44.106535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:44.107077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.107446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.107714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.107908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:44.108439 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:44.108751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:44.136787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:44.160126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 946/1895] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:44.162279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:44.164781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.180163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3526c5f7784a41eb904260a4e8588e08'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.186701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44a49e-6f85-4346-aa41-6eff3a8e6ecd admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:44.193652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:44.193836 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3526c5f7784a41eb904260a4e8588e08'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.194853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3526c5f7784a41eb904260a4e8588e08'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.194962 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.195244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.195470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] PATH_INFO: `/v3/projects/ece9676b085e4fad8059404b1dd4c9e7` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.196610 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece9676b085e4fad8059404b1dd4c9e7)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:44.203218 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3526c5f7784a41eb904260a4e8588e08'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.211695 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3526c5f7784a41eb904260a4e8588e08'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.218424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 950/1896] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:44 2021] DELETE /identity/v3/users/3526c5f7784a41eb904260a4e8588e08 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:44.219379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:44.223522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:44.225494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.297124 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece9676b085e4fad8059404b1dd4c9e7', 'request_id': 'req-3e15fdba-c00b-4749-b099-bbc66a031bb0'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.323988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece9676b085e4fad8059404b1dd4c9e7', 'request_id': 'req-3e15fdba-c00b-4749-b099-bbc66a031bb0'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.336991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece9676b085e4fad8059404b1dd4c9e7', 'request_id': 'req-3e15fdba-c00b-4749-b099-bbc66a031bb0'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.340924 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd721dfd-43ab-4e66-830d-116d046687dd admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:44.355170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] The token cache is being invalidate because project ece9676b085e4fad8059404b1dd4c9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:44.355490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.356134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3e15fdba-c00b-4749-b099-bbc66a031bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.359877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 947/1897] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:44 2021] DELETE /identity/v3/projects/ece9676b085e4fad8059404b1dd4c9e7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:44.361407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6be8-bac8-47a1-8d0f-8d5dfca32b4b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.361704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6be8-bac8-47a1-8d0f-8d5dfca32b4b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.362255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6be8-bac8-47a1-8d0f-8d5dfca32b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.397371 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b52f6be8-bac8-47a1-8d0f-8d5dfca32b4b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:44.398538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b52f6be8-bac8-47a1-8d0f-8d5dfca32b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.443971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5046317-72a2-4ab8-b14b-0ebeb111ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:44.444837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5046317-72a2-4ab8-b14b-0ebeb111ecbb admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.445417 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5046317-72a2-4ab8-b14b-0ebeb111ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.445867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5046317-72a2-4ab8-b14b-0ebeb111ecbb admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.446519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5046317-72a2-4ab8-b14b-0ebeb111ecbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:44.476898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5046317-72a2-4ab8-b14b-0ebeb111ecbb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:44.479584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 948/1898] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:44.480605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6be8-bac8-47a1-8d0f-8d5dfca32b4b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:44.484505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b52f6be8-bac8-47a1-8d0f-8d5dfca32b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.498139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6be8-bac8-47a1-8d0f-8d5dfca32b4b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:44.503668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:44.505386 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.505773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.506020 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] PATH_INFO: `/v3/users/78f9fc2c6c6f4bc09a265d45bdab22a6` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.507436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f9fc2c6c6f4bc09a265d45bdab22a6)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:44.513419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 951/1899] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:44 2021] POST /identity/v3/projects => generated 373 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:44.514483 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5046317-72a2-4ab8-b14b-0ebeb111ecbb admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:44.516261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d5046317-72a2-4ab8-b14b-0ebeb111ecbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.535178 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:44.601532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5046317-72a2-4ab8-b14b-0ebeb111ecbb admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:44.605465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14572311-893a-499b-bebf-a1b926b00792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:44.606210 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14572311-893a-499b-bebf-a1b926b00792 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.606514 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14572311-893a-499b-bebf-a1b926b00792 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.606851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14572311-893a-499b-bebf-a1b926b00792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.611246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f9fc2c6c6f4bc09a265d45bdab22a6'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.625773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f9fc2c6c6f4bc09a265d45bdab22a6'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.626650 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f9fc2c6c6f4bc09a265d45bdab22a6'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.638151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f9fc2c6c6f4bc09a265d45bdab22a6'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.653077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f9fc2c6c6f4bc09a265d45bdab22a6'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:44.660671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 949/1900] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:44 2021] DELETE /identity/v3/users/78f9fc2c6c6f4bc09a265d45bdab22a6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:44.661989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:44.663555 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.745727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14572311-893a-499b-bebf-a1b926b00792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:44.780946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14572311-893a-499b-bebf-a1b926b00792 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:44.795297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 952/1901] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:44.832508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd465d2-1b82-4a7f-82cb-c24aa6d90207 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:44.844357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792b38-1515-47a4-9139-881d0ade2a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:44.845664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792b38-1515-47a4-9139-881d0ade2a8f admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.846587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792b38-1515-47a4-9139-881d0ade2a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.847051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1792b38-1515-47a4-9139-881d0ade2a8f admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.849591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1792b38-1515-47a4-9139-881d0ade2a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:44.885775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1792b38-1515-47a4-9139-881d0ade2a8f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:44.922725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 950/1902] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:44 2021] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:44.927350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14572311-893a-499b-bebf-a1b926b00792 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:44.930250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-14572311-893a-499b-bebf-a1b926b00792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:44.951311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14572311-893a-499b-bebf-a1b926b00792 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:44.967368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a833e-e349-44a6-aaf8-f420504a85bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:44.968095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a833e-e349-44a6-aaf8-f420504a85bb admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:44.968394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a833e-e349-44a6-aaf8-f420504a85bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:44.968685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a833e-e349-44a6-aaf8-f420504a85bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:44.969568 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a833e-e349-44a6-aaf8-f420504a85bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:45.010591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a833e-e349-44a6-aaf8-f420504a85bb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:45.039269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 953/1903] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:44 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:45.042981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792b38-1515-47a4-9139-881d0ade2a8f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:45.057318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1792b38-1515-47a4-9139-881d0ade2a8f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:45.068568 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a473f-816c-48cf-87df-2fce7a24296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:45.069816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a473f-816c-48cf-87df-2fce7a24296a admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:45.070874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a473f-816c-48cf-87df-2fce7a24296a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:45.071873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a473f-816c-48cf-87df-2fce7a24296a admin admin] PATH_INFO: `/v3/projects/076d0906af24471cb4831b6aa7ed91a4/users/eb33b92997474322a0e9bd62bc3a5e7b/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:45.120082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a473f-816c-48cf-87df-2fce7a24296a admin admin] RBAC: Authorizing `identity:create_grant(project_id=076d0906af24471cb4831b6aa7ed91a4, user_id=eb33b92997474322a0e9bd62bc3a5e7b, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:45.156192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a473f-816c-48cf-87df-2fce7a24296a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:45.171951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 951/1904] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:45 2021] PUT /identity/v3/projects/076d0906af24471cb4831b6aa7ed91a4/users/eb33b92997474322a0e9bd62bc3a5e7b/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:45.182002 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61d69-9676-4775-8ca7-344292bcce25 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:45.182310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61d69-9676-4775-8ca7-344292bcce25 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:45.182606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61d69-9676-4775-8ca7-344292bcce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:45.222172 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7bc61d69-9676-4775-8ca7-344292bcce25 None None] MFA Rules not processed for user `eb33b92997474322a0e9bd62bc3a5e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:45.223286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7bc61d69-9676-4775-8ca7-344292bcce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:45.346242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 954/1905] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:45 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:45.506337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a473f-816c-48cf-87df-2fce7a24296a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:45.507910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-197a473f-816c-48cf-87df-2fce7a24296a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:45.578141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc61d69-9676-4775-8ca7-344292bcce25 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:45.580010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7bc61d69-9676-4775-8ca7-344292bcce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:45.685339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a473f-816c-48cf-87df-2fce7a24296a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:45.692122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5dd02-e6ca-477b-b57f-c7f39b203940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:45.693725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5dd02-e6ca-477b-b57f-c7f39b203940 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:45.694164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5dd02-e6ca-477b-b57f-c7f39b203940 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:45.694719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5dd02-e6ca-477b-b57f-c7f39b203940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:45.716643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5dd02-e6ca-477b-b57f-c7f39b203940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:45.738387 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc61d69-9676-4775-8ca7-344292bcce25 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:45.745871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:45.747321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:45.747774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:45.748583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] PATH_INFO: `/v3/projects/4754f940d6a64acda03f553daa405e71` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:45.750700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4754f940d6a64acda03f553daa405e71)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:45.777564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5dd02-e6ca-477b-b57f-c7f39b203940 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:45.800110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 952/1906] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:45 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:45.801294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5dd02-e6ca-477b-b57f-c7f39b203940 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:45.802953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-dca5dd02-e6ca-477b-b57f-c7f39b203940 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:45.820900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:45.824057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5dd02-e6ca-477b-b57f-c7f39b203940 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:45.836901 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:45.837907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:45.838505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:45.838974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] PATH_INFO: `/v3/projects/69110ac6db89416495b1c019d6c8580b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:45.840318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69110ac6db89416495b1c019d6c8580b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:45.870454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:45.963333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4754f940d6a64acda03f553daa405e71', 'request_id': 'req-255c08d6-8da1-4989-8c94-2236c5d002b1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:45.971426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69110ac6db89416495b1c019d6c8580b', 'request_id': 'req-b42ee294-3338-4544-a238-7a6f22db0ff7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:45.998090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69110ac6db89416495b1c019d6c8580b', 'request_id': 'req-b42ee294-3338-4544-a238-7a6f22db0ff7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.012738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69110ac6db89416495b1c019d6c8580b', 'request_id': 'req-b42ee294-3338-4544-a238-7a6f22db0ff7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.023199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4754f940d6a64acda03f553daa405e71', 'request_id': 'req-255c08d6-8da1-4989-8c94-2236c5d002b1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.036934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] The token cache is being invalidate because project 69110ac6db89416495b1c019d6c8580b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:46.037757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.040606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4754f940d6a64acda03f553daa405e71', 'request_id': 'req-255c08d6-8da1-4989-8c94-2236c5d002b1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.041049 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.043296 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 953/1907] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:45 2021] DELETE /identity/v3/projects/69110ac6db89416495b1c019d6c8580b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:46.049440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:46.054413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:46.071256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] The token cache is being invalidate because project 4754f940d6a64acda03f553daa405e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:46.071256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.076524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-255c08d6-8da1-4989-8c94-2236c5d002b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.084872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 955/1908] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:45 2021] DELETE /identity/v3/projects/4754f940d6a64acda03f553daa405e71 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:46.088056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ecbe8-bc3b-416e-8b0a-8e7726476556 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:46.088678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ecbe8-bc3b-416e-8b0a-8e7726476556 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:46.088678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ecbe8-bc3b-416e-8b0a-8e7726476556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:46.136264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1e7ecbe8-bc3b-416e-8b0a-8e7726476556 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:46.137437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1e7ecbe8-bc3b-416e-8b0a-8e7726476556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:46.181026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ee294-3338-4544-a238-7a6f22db0ff7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:46.188124 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:46.189162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:46.190166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:46.190558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] PATH_INFO: `/v3/users/1977fcce862e49158079a9d0712d5c76` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:46.192819 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1977fcce862e49158079a9d0712d5c76)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:46.229033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:46.292244 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 956/1909] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:46.299508 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d326-f0ae-4ad3-96b7-77bd9a633b5d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:46.299816 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d326-f0ae-4ad3-96b7-77bd9a633b5d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:46.300227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d326-f0ae-4ad3-96b7-77bd9a633b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:46.323363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1977fcce862e49158079a9d0712d5c76'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.351441 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-89f5d326-f0ae-4ad3-96b7-77bd9a633b5d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:46.352677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-89f5d326-f0ae-4ad3-96b7-77bd9a633b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:46.354218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1977fcce862e49158079a9d0712d5c76'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.355278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1977fcce862e49158079a9d0712d5c76'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.383279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 957/1910] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:46.389550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d326-f0ae-4ad3-96b7-77bd9a633b5d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:46.420139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1977fcce862e49158079a9d0712d5c76'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.420359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d326-f0ae-4ad3-96b7-77bd9a633b5d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:46.434090 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f051fd8-8060-4559-87aa-35e1c8543e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:46.435073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f051fd8-8060-4559-87aa-35e1c8543e66 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:46.435073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f051fd8-8060-4559-87aa-35e1c8543e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:46.435379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f051fd8-8060-4559-87aa-35e1c8543e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:46.435978 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1977fcce862e49158079a9d0712d5c76'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:46.436399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f051fd8-8060-4559-87aa-35e1c8543e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:46.438790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f051fd8-8060-4559-87aa-35e1c8543e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:46.458659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 954/1911] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:46 2021] DELETE /identity/v3/users/1977fcce862e49158079a9d0712d5c76 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:46.497129 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f051fd8-8060-4559-87aa-35e1c8543e66 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:46.530319 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 958/1912] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:46.540762 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:46.542732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:46.695433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341d7b0-a06e-491c-843b-186d55ff8c2f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:46.702878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c849d-80f2-407c-b4c4-deec7efb0bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:46.703918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c849d-80f2-407c-b4c4-deec7efb0bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:46.704441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c849d-80f2-407c-b4c4-deec7efb0bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:46.705053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c849d-80f2-407c-b4c4-deec7efb0bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:46.705886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c849d-80f2-407c-b4c4-deec7efb0bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:46.750271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c849d-80f2-407c-b4c4-deec7efb0bf5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:46.790057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 955/1913] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:46 2021] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:46.793808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f051fd8-8060-4559-87aa-35e1c8543e66 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:46.815858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f051fd8-8060-4559-87aa-35e1c8543e66 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:46.911765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964f2ce-feec-4acd-951c-ffe28d66557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:46.912697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964f2ce-feec-4acd-951c-ffe28d66557b admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:46.913090 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964f2ce-feec-4acd-951c-ffe28d66557b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:46.913775 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964f2ce-feec-4acd-951c-ffe28d66557b admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:46.914993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964f2ce-feec-4acd-951c-ffe28d66557b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:46.957557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964f2ce-feec-4acd-951c-ffe28d66557b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.004409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 959/1914] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:46 2021] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:47.005949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c849d-80f2-407c-b4c4-deec7efb0bf5 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.016590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c849d-80f2-407c-b4c4-deec7efb0bf5 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:47.021775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e6a26-30af-4baf-a473-e7074c8ac7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:47.022394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e6a26-30af-4baf-a473-e7074c8ac7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.022719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e6a26-30af-4baf-a473-e7074c8ac7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.023011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e6a26-30af-4baf-a473-e7074c8ac7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.024118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e6a26-30af-4baf-a473-e7074c8ac7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:47.062395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e6a26-30af-4baf-a473-e7074c8ac7e4 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.079505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 956/1915] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:47 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:47.084120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964f2ce-feec-4acd-951c-ffe28d66557b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.094955 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964f2ce-feec-4acd-951c-ffe28d66557b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:47.100734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a68e9f-cf4b-4b14-848d-a9d2796f0604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:47.101651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68e9f-cf4b-4b14-848d-a9d2796f0604 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.102420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68e9f-cf4b-4b14-848d-a9d2796f0604 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.102420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68e9f-cf4b-4b14-848d-a9d2796f0604 admin admin] PATH_INFO: `/v3/projects/a3c6f753fc5e4a26a798885b5c3d4fd1/users/26207d11f27a4df595db7a10f68084bf/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.127371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a68e9f-cf4b-4b14-848d-a9d2796f0604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c6f753fc5e4a26a798885b5c3d4fd1, user_id=26207d11f27a4df595db7a10f68084bf, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:47.161750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a68e9f-cf4b-4b14-848d-a9d2796f0604 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.190705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 960/1916] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:47 2021] PUT /identity/v3/projects/a3c6f753fc5e4a26a798885b5c3d4fd1/users/26207d11f27a4df595db7a10f68084bf/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:47.191985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165507a8-2609-4a19-945c-a939a93c2bcd None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.193198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165507a8-2609-4a19-945c-a939a93c2bcd None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.193198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165507a8-2609-4a19-945c-a939a93c2bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.333560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a68e9f-cf4b-4b14-848d-a9d2796f0604 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.335444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b3a68e9f-cf4b-4b14-848d-a9d2796f0604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:47.386317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-165507a8-2609-4a19-945c-a939a93c2bcd None None] MFA Rules not processed for user `26207d11f27a4df595db7a10f68084bf`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:47.387543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-165507a8-2609-4a19-945c-a939a93c2bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:47.482381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 957/1917] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:47 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:47.488392 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165507a8-2609-4a19-945c-a939a93c2bcd None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.530454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a68e9f-cf4b-4b14-848d-a9d2796f0604 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:47.535908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:47.537761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.538304 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.538769 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] PATH_INFO: `/v3/projects/3d19ae7d1f8e4f56ba2ec8cf53531819` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.540938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d19ae7d1f8e4f56ba2ec8cf53531819)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:47.575412 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165507a8-2609-4a19-945c-a939a93c2bcd None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:47.576173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.581875 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322016f6-e4bb-4aaa-90cf-2c62c2cb2424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:47.583953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322016f6-e4bb-4aaa-90cf-2c62c2cb2424 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.584487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322016f6-e4bb-4aaa-90cf-2c62c2cb2424 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.584972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322016f6-e4bb-4aaa-90cf-2c62c2cb2424 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.586284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322016f6-e4bb-4aaa-90cf-2c62c2cb2424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:47.620404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322016f6-e4bb-4aaa-90cf-2c62c2cb2424 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.635582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d19ae7d1f8e4f56ba2ec8cf53531819', 'request_id': 'req-56d198d0-e693-42ab-9642-05381587ad09'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:47.650105 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d19ae7d1f8e4f56ba2ec8cf53531819', 'request_id': 'req-56d198d0-e693-42ab-9642-05381587ad09'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:47.653565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 958/1918] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:47 2021] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:47.654898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322016f6-e4bb-4aaa-90cf-2c62c2cb2424 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.659001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d19ae7d1f8e4f56ba2ec8cf53531819', 'request_id': 'req-56d198d0-e693-42ab-9642-05381587ad09'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:47.671553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] The token cache is being invalidate because project 3d19ae7d1f8e4f56ba2ec8cf53531819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:47.671927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:47.672484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-56d198d0-e693-42ab-9642-05381587ad09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:47.674144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 961/1919] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:47 2021] DELETE /identity/v3/projects/3d19ae7d1f8e4f56ba2ec8cf53531819 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:47.680276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74488d51-d934-4091-be6d-4814d458b9d9 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.680567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74488d51-d934-4091-be6d-4814d458b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.680850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74488d51-d934-4091-be6d-4814d458b9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.703337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-74488d51-d934-4091-be6d-4814d458b9d9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:47.704583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-74488d51-d934-4091-be6d-4814d458b9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:47.730103 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322016f6-e4bb-4aaa-90cf-2c62c2cb2424 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:47.734808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46548f5-9403-4e77-bb80-86f6e5c12654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:47.735418 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46548f5-9403-4e77-bb80-86f6e5c12654 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.735715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46548f5-9403-4e77-bb80-86f6e5c12654 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.735989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46548f5-9403-4e77-bb80-86f6e5c12654 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.736627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46548f5-9403-4e77-bb80-86f6e5c12654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:47.763998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46548f5-9403-4e77-bb80-86f6e5c12654 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.781547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 962/1920] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:47.787912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 959/1921] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:47 2021] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:47.789684 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a67b1-efed-4da5-b7a7-6c602d11a476 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.789825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74488d51-d934-4091-be6d-4814d458b9d9 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.790137 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a67b1-efed-4da5-b7a7-6c602d11a476 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.790448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a67b1-efed-4da5-b7a7-6c602d11a476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.791100 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-74488d51-d934-4091-be6d-4814d458b9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:47.802978 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74488d51-d934-4091-be6d-4814d458b9d9 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:47.808795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0d950-b49b-4960-a7d0-1cf27768a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:47.809424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0d950-b49b-4960-a7d0-1cf27768a30f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.809794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0d950-b49b-4960-a7d0-1cf27768a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.810147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0d950-b49b-4960-a7d0-1cf27768a30f admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.810973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0d950-b49b-4960-a7d0-1cf27768a30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:47.816959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-157a67b1-efed-4da5-b7a7-6c602d11a476 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:47.818664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-157a67b1-efed-4da5-b7a7-6c602d11a476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:47.826860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 960/1922] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:47.830548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a67b1-efed-4da5-b7a7-6c602d11a476 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.838078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0d950-b49b-4960-a7d0-1cf27768a30f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.840833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a67b1-efed-4da5-b7a7-6c602d11a476 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:47.845142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84556-54be-42ce-976d-324b1d7f5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:47.845768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84556-54be-42ce-976d-324b1d7f5848 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.846208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84556-54be-42ce-976d-324b1d7f5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.846530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84556-54be-42ce-976d-324b1d7f5848 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.847339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec84556-54be-42ce-976d-324b1d7f5848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:47.847640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec84556-54be-42ce-976d-324b1d7f5848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:47.849578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 963/1923] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:47 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:47.853621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0d950-b49b-4960-a7d0-1cf27768a30f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.863698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0d950-b49b-4960-a7d0-1cf27768a30f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:47.868457 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a855-607e-4f28-92ba-f6e6910d2305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:47.869269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a855-607e-4f28-92ba-f6e6910d2305 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.869560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a855-607e-4f28-92ba-f6e6910d2305 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.869856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a855-607e-4f28-92ba-f6e6910d2305 admin admin] PATH_INFO: `/v3/projects/b8e8df4a0e6541e1a95f328f9c326359/users/049317a8dd124f55874cbcd2fe3c1173/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.873996 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec84556-54be-42ce-976d-324b1d7f5848 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.888276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 961/1924] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:47.891476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386a855-607e-4f28-92ba-f6e6910d2305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e8df4a0e6541e1a95f328f9c326359, user_id=049317a8dd124f55874cbcd2fe3c1173, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:47.892617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84556-54be-42ce-976d-324b1d7f5848 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.902130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84556-54be-42ce-976d-324b1d7f5848 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:47.906308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321e08-bc65-4ddc-a470-94397fc0665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:47.906924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321e08-bc65-4ddc-a470-94397fc0665b admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:47.907217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321e08-bc65-4ddc-a470-94397fc0665b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:47.907500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321e08-bc65-4ddc-a470-94397fc0665b admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:47.908126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76321e08-bc65-4ddc-a470-94397fc0665b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:47.918739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386a855-607e-4f28-92ba-f6e6910d2305 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.932368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 964/1925] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:47 2021] PUT /identity/v3/projects/b8e8df4a0e6541e1a95f328f9c326359/users/049317a8dd124f55874cbcd2fe3c1173/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:47.935732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76321e08-bc65-4ddc-a470-94397fc0665b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:47.936264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a855-607e-4f28-92ba-f6e6910d2305 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:47.971957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 962/1926] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:47 2021] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:47.974274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321e08-bc65-4ddc-a470-94397fc0665b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.009658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a855-607e-4f28-92ba-f6e6910d2305 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.066860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321e08-bc65-4ddc-a470-94397fc0665b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.071982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72278f86-1b6d-47d3-a730-dc036c3c1ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.072596 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72278f86-1b6d-47d3-a730-dc036c3c1ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.072895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72278f86-1b6d-47d3-a730-dc036c3c1ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.073183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72278f86-1b6d-47d3-a730-dc036c3c1ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.073851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72278f86-1b6d-47d3-a730-dc036c3c1ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.089476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746bc7-4ff8-46ce-9656-e53ae841f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.090084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746bc7-4ff8-46ce-9656-e53ae841f383 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.090373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746bc7-4ff8-46ce-9656-e53ae841f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.090674 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746bc7-4ff8-46ce-9656-e53ae841f383 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.091393 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73746bc7-4ff8-46ce-9656-e53ae841f383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.100360 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72278f86-1b6d-47d3-a730-dc036c3c1ec2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.121142 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73746bc7-4ff8-46ce-9656-e53ae841f383 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.122324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 963/1927] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:47 2021] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:48.123595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27dd40-79b6-4dc4-a31e-142e18e576a5 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.124060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27dd40-79b6-4dc4-a31e-142e18e576a5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.124349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27dd40-79b6-4dc4-a31e-142e18e576a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.136541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 965/1928] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:47 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:48.136541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746bc7-4ff8-46ce-9656-e53ae841f383 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.148795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ee27dd40-79b6-4dc4-a31e-142e18e576a5 None None] MFA Rules not processed for user `eb33b92997474322a0e9bd62bc3a5e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:48.150148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ee27dd40-79b6-4dc4-a31e-142e18e576a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:48.151014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746bc7-4ff8-46ce-9656-e53ae841f383 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.155850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c30b7d-2108-4b53-b76c-59e904fe5b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.156573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c30b7d-2108-4b53-b76c-59e904fe5b11 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.156866 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c30b7d-2108-4b53-b76c-59e904fe5b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.157154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c30b7d-2108-4b53-b76c-59e904fe5b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.157850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c30b7d-2108-4b53-b76c-59e904fe5b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.185140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c30b7d-2108-4b53-b76c-59e904fe5b11 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.196512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 966/1929] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:48 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:48.200513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c30b7d-2108-4b53-b76c-59e904fe5b11 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.210650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c30b7d-2108-4b53-b76c-59e904fe5b11 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.215658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c2461-6eff-4cfc-a2f0-1e56326b490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.216481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c2461-6eff-4cfc-a2f0-1e56326b490a admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.217249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c2461-6eff-4cfc-a2f0-1e56326b490a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.217249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c2461-6eff-4cfc-a2f0-1e56326b490a admin admin] PATH_INFO: `/v3/projects/b8e8df4a0e6541e1a95f328f9c326359/users/049317a8dd124f55874cbcd2fe3c1173/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.217510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 964/1930] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:48 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:48.217985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27dd40-79b6-4dc4-a31e-142e18e576a5 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.219505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c2461-6eff-4cfc-a2f0-1e56326b490a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e8df4a0e6541e1a95f328f9c326359, user_id=049317a8dd124f55874cbcd2fe3c1173, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.229160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27dd40-79b6-4dc4-a31e-142e18e576a5 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.234106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f84c6-a9ec-4eae-8ea0-1a406e0f0a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.235094 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f84c6-a9ec-4eae-8ea0-1a406e0f0a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.235498 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f84c6-a9ec-4eae-8ea0-1a406e0f0a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.236026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f84c6-a9ec-4eae-8ea0-1a406e0f0a9b admin admin] PATH_INFO: `/v3/projects/db5fb8ab07294518a96db6d1c41ea28e/users/4679030965b84d87899dab2e92bd37ec/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.259300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c2461-6eff-4cfc-a2f0-1e56326b490a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.267629 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f84c6-a9ec-4eae-8ea0-1a406e0f0a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5fb8ab07294518a96db6d1c41ea28e, user_id=4679030965b84d87899dab2e92bd37ec, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.273273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 967/1931] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:48 2021] PUT /identity/v3/projects/b8e8df4a0e6541e1a95f328f9c326359/users/049317a8dd124f55874cbcd2fe3c1173/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:48.277436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c2461-6eff-4cfc-a2f0-1e56326b490a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.295834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f84c6-a9ec-4eae-8ea0-1a406e0f0a9b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.309908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 965/1932] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:48 2021] PUT /identity/v3/projects/db5fb8ab07294518a96db6d1c41ea28e/users/4679030965b84d87899dab2e92bd37ec/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:48.322006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f7764-1585-4111-b967-5b7a24a4b0a0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.322230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f7764-1585-4111-b967-5b7a24a4b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.322721 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f7764-1585-4111-b967-5b7a24a4b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.369446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-3f5f7764-1585-4111-b967-5b7a24a4b0a0 None None] MFA Rules not processed for user `4679030965b84d87899dab2e92bd37ec`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:48.370668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3f5f7764-1585-4111-b967-5b7a24a4b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:48.386169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c2461-6eff-4cfc-a2f0-1e56326b490a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.461098 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 966/1933] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:48 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:48.465679 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f7764-1585-4111-b967-5b7a24a4b0a0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.466823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31d72f-d34e-4348-90d4-2a4d564bdca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.467446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d72f-d34e-4348-90d4-2a4d564bdca0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.467729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d72f-d34e-4348-90d4-2a4d564bdca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.468150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d72f-d34e-4348-90d4-2a4d564bdca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.468856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31d72f-d34e-4348-90d4-2a4d564bdca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.477449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f7764-1585-4111-b967-5b7a24a4b0a0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.481796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc54847-503b-437f-a3f0-f327c428c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.482390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc54847-503b-437f-a3f0-f327c428c156 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.482719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc54847-503b-437f-a3f0-f327c428c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.483010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc54847-503b-437f-a3f0-f327c428c156 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.483645 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc54847-503b-437f-a3f0-f327c428c156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.495712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31d72f-d34e-4348-90d4-2a4d564bdca0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.509604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 968/1934] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:48 2021] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:48.509791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc54847-503b-437f-a3f0-f327c428c156 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.510588 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31d72f-d34e-4348-90d4-2a4d564bdca0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.521055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31d72f-d34e-4348-90d4-2a4d564bdca0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.525461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0b093-065d-4f1a-bd2e-f75f365b569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.526287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0b093-065d-4f1a-bd2e-f75f365b569d admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.526687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0b093-065d-4f1a-bd2e-f75f365b569d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.530720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0b093-065d-4f1a-bd2e-f75f365b569d admin admin] PATH_INFO: `/v3/projects/b8e8df4a0e6541e1a95f328f9c326359/users/049317a8dd124f55874cbcd2fe3c1173/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.532976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0b093-065d-4f1a-bd2e-f75f365b569d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e8df4a0e6541e1a95f328f9c326359, user_id=049317a8dd124f55874cbcd2fe3c1173, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.543074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 967/1935] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:48 2021] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:48.544115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc54847-503b-437f-a3f0-f327c428c156 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.565481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0b093-065d-4f1a-bd2e-f75f365b569d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.583811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 969/1936] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:48 2021] PUT /identity/v3/projects/b8e8df4a0e6541e1a95f328f9c326359/users/049317a8dd124f55874cbcd2fe3c1173/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:48.593655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bbf73-00ea-4753-8046-f8c1b5a8003e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.593954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bbf73-00ea-4753-8046-f8c1b5a8003e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.594239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bbf73-00ea-4753-8046-f8c1b5a8003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.633279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc54847-503b-437f-a3f0-f327c428c156 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.646161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c67bbf73-00ea-4753-8046-f8c1b5a8003e None None] MFA Rules not processed for user `049317a8dd124f55874cbcd2fe3c1173`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:48.648086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c67bbf73-00ea-4753-8046-f8c1b5a8003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:48.737599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12da3-2e5e-474b-86f5-39ca1da4d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.738211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12da3-2e5e-474b-86f5-39ca1da4d9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.738502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12da3-2e5e-474b-86f5-39ca1da4d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.738816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12da3-2e5e-474b-86f5-39ca1da4d9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.740391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c12da3-2e5e-474b-86f5-39ca1da4d9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.756749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 970/1937] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:48 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:48.764129 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bbf73-00ea-4753-8046-f8c1b5a8003e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.766297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c67bbf73-00ea-4753-8046-f8c1b5a8003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:48.772101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c12da3-2e5e-474b-86f5-39ca1da4d9f1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.794927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 968/1938] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:48 2021] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:48.799460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12da3-2e5e-474b-86f5-39ca1da4d9f1 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.825866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12da3-2e5e-474b-86f5-39ca1da4d9f1 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.837280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce1d4-c237-445b-afe8-cd5929824e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.841677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce1d4-c237-445b-afe8-cd5929824e96 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.842196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce1d4-c237-445b-afe8-cd5929824e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.843068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce1d4-c237-445b-afe8-cd5929824e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.844575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce1d4-c237-445b-afe8-cd5929824e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.859257 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bbf73-00ea-4753-8046-f8c1b5a8003e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.863738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f388d-66cc-4025-a8fe-6f608e9cff21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.864744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f388d-66cc-4025-a8fe-6f608e9cff21 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.865775 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f388d-66cc-4025-a8fe-6f608e9cff21 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.866214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f388d-66cc-4025-a8fe-6f608e9cff21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.868661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-335f388d-66cc-4025-a8fe-6f608e9cff21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:48.893692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce1d4-c237-445b-afe8-cd5929824e96 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.906227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 969/1939] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:48 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:48.911051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce1d4-c237-445b-afe8-cd5929824e96 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:48.921094 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce1d4-c237-445b-afe8-cd5929824e96 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:48.925462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4c6d6-07d9-4bcb-a1f3-d148433dbb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:48.926441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4c6d6-07d9-4bcb-a1f3-d148433dbb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:48.926949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4c6d6-07d9-4bcb-a1f3-d148433dbb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:48.927423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4c6d6-07d9-4bcb-a1f3-d148433dbb84 admin admin] PATH_INFO: `/v3/projects/c2c1d6d73a5d4be098fd214c2081d058/users/47a4a12d24cd4d9c9896c7d61dc96c29/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:48.944854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f388d-66cc-4025-a8fe-6f608e9cff21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.949230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4c6d6-07d9-4bcb-a1f3-d148433dbb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c1d6d73a5d4be098fd214c2081d058, user_id=47a4a12d24cd4d9c9896c7d61dc96c29, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:48.971722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f388d-66cc-4025-a8fe-6f608e9cff21 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.977755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4c6d6-07d9-4bcb-a1f3-d148433dbb84 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:48.984690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 971/1940] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:48 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:48.994679 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 970/1941] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:48 2021] PUT /identity/v3/projects/c2c1d6d73a5d4be098fd214c2081d058/users/47a4a12d24cd4d9c9896c7d61dc96c29/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:12:48.999622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f388d-66cc-4025-a8fe-6f608e9cff21 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:49.010794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f388d-66cc-4025-a8fe-6f608e9cff21 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:49.091235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8975e-5516-4e5a-914a-d8b9a75d1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:49.092764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8975e-5516-4e5a-914a-d8b9a75d1c0c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:49.092764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8975e-5516-4e5a-914a-d8b9a75d1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:49.092764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8975e-5516-4e5a-914a-d8b9a75d1c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:49.093427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8975e-5516-4e5a-914a-d8b9a75d1c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:49.122738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8975e-5516-4e5a-914a-d8b9a75d1c0c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:49.135271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 972/1942] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:48 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:49.139443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4c6d6-07d9-4bcb-a1f3-d148433dbb84 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:49.150346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4c6d6-07d9-4bcb-a1f3-d148433dbb84 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:49.155942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be084e-7450-402c-9e3c-1333892dc3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:49.156877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be084e-7450-402c-9e3c-1333892dc3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:49.157312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be084e-7450-402c-9e3c-1333892dc3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:49.158294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be084e-7450-402c-9e3c-1333892dc3e6 admin admin] PATH_INFO: `/v3/projects/c2c1d6d73a5d4be098fd214c2081d058/users/47a4a12d24cd4d9c9896c7d61dc96c29/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:49.160936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be084e-7450-402c-9e3c-1333892dc3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c1d6d73a5d4be098fd214c2081d058, user_id=47a4a12d24cd4d9c9896c7d61dc96c29, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:49.190011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be084e-7450-402c-9e3c-1333892dc3e6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:49.203283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 971/1943] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:49 2021] PUT /identity/v3/projects/c2c1d6d73a5d4be098fd214c2081d058/users/47a4a12d24cd4d9c9896c7d61dc96c29/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:49.207208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8975e-5516-4e5a-914a-d8b9a75d1c0c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:49.220215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8975e-5516-4e5a-914a-d8b9a75d1c0c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:49.293409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb95c2-03bf-4852-8bba-2be7c88229ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:49.294077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb95c2-03bf-4852-8bba-2be7c88229ce admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:49.294311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb95c2-03bf-4852-8bba-2be7c88229ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:49.294660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb95c2-03bf-4852-8bba-2be7c88229ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:49.295355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb95c2-03bf-4852-8bba-2be7c88229ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:49.322544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb95c2-03bf-4852-8bba-2be7c88229ce admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:49.334022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 973/1944] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:49 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:12:49.338377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be084e-7450-402c-9e3c-1333892dc3e6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:49.349206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be084e-7450-402c-9e3c-1333892dc3e6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:49.354058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a39bc-92af-487b-ab02-c3aa81968ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:49.356134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a39bc-92af-487b-ab02-c3aa81968ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:49.356134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a39bc-92af-487b-ab02-c3aa81968ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:49.356134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a39bc-92af-487b-ab02-c3aa81968ca9 admin admin] PATH_INFO: `/v3/projects/c2c1d6d73a5d4be098fd214c2081d058/users/47a4a12d24cd4d9c9896c7d61dc96c29/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:49.357274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a39bc-92af-487b-ab02-c3aa81968ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c1d6d73a5d4be098fd214c2081d058, user_id=47a4a12d24cd4d9c9896c7d61dc96c29, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:49.385781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a39bc-92af-487b-ab02-c3aa81968ca9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:49.402739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 972/1945] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:49 2021] PUT /identity/v3/projects/c2c1d6d73a5d4be098fd214c2081d058/users/47a4a12d24cd4d9c9896c7d61dc96c29/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:49.413456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400f3b-b440-4802-9f13-2701ceff8717 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:49.413813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400f3b-b440-4802-9f13-2701ceff8717 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:49.414404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400f3b-b440-4802-9f13-2701ceff8717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:49.457526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-51400f3b-b440-4802-9f13-2701ceff8717 None None] MFA Rules not processed for user `47a4a12d24cd4d9c9896c7d61dc96c29`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:49.459368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-51400f3b-b440-4802-9f13-2701ceff8717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:49.537990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 974/1946] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:49 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:49.671695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a39bc-92af-487b-ab02-c3aa81968ca9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:49.734689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a39bc-92af-487b-ab02-c3aa81968ca9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:49.738183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acfd9e-22e9-48a0-a131-b905ed0dd87d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:49.738799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acfd9e-22e9-48a0-a131-b905ed0dd87d service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:49.739085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acfd9e-22e9-48a0-a131-b905ed0dd87d service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:49.740018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acfd9e-22e9-48a0-a131-b905ed0dd87d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:49.753334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acfd9e-22e9-48a0-a131-b905ed0dd87d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:49.779390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acfd9e-22e9-48a0-a131-b905ed0dd87d service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:49.789742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 973/1947] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:49 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:51.456366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400f3b-b440-4802-9f13-2701ceff8717 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:51.544148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400f3b-b440-4802-9f13-2701ceff8717 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:51.553269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:51.554112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:51.554341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:51.554740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] PATH_INFO: `/v3/users/4679030965b84d87899dab2e92bd37ec` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:51.555841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4679030965b84d87899dab2e92bd37ec)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:51.581797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:51.659464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4679030965b84d87899dab2e92bd37ec'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:51.683071 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4679030965b84d87899dab2e92bd37ec'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:51.684885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4679030965b84d87899dab2e92bd37ec'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:51.698068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4679030965b84d87899dab2e92bd37ec'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:51.710054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4679030965b84d87899dab2e92bd37ec'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:51.720310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 975/1948] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:51 2021] DELETE /identity/v3/users/4679030965b84d87899dab2e92bd37ec => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:51.725277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6be31-c51a-42c7-a315-7ef71b4a3d65 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:51.725769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6be31-c51a-42c7-a315-7ef71b4a3d65 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:51.725877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6be31-c51a-42c7-a315-7ef71b4a3d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:51.753039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-f9c6be31-c51a-42c7-a315-7ef71b4a3d65 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:51.755387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-f9c6be31-c51a-42c7-a315-7ef71b4a3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:51.839174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 974/1949] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:51.850728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:51.852619 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:51.924820 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b786b70-02e9-4fec-8dcb-ad62243456b5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:51.928306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae83bc-d5f6-4d40-9b74-97191d7f6eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:51.928887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae83bc-d5f6-4d40-9b74-97191d7f6eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:51.929186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae83bc-d5f6-4d40-9b74-97191d7f6eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:51.929451 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae83bc-d5f6-4d40-9b74-97191d7f6eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:51.938134 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae83bc-d5f6-4d40-9b74-97191d7f6eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:51.964215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae83bc-d5f6-4d40-9b74-97191d7f6eb4 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:51.974669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 976/1950] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:52.392490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6be31-c51a-42c7-a315-7ef71b4a3d65 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:52.394029 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-f9c6be31-c51a-42c7-a315-7ef71b4a3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:52.411975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6be31-c51a-42c7-a315-7ef71b4a3d65 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:52.428387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:52.435491 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:52.436015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:52.436470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] PATH_INFO: `/v3/projects/db5fb8ab07294518a96db6d1c41ea28e` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:52.439558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5fb8ab07294518a96db6d1c41ea28e)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:52.506479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:52.592622 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5fb8ab07294518a96db6d1c41ea28e', 'request_id': 'req-38ea679b-f353-443e-b3b7-5a16ebc22bf3'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.607409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5fb8ab07294518a96db6d1c41ea28e', 'request_id': 'req-38ea679b-f353-443e-b3b7-5a16ebc22bf3'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.617782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5fb8ab07294518a96db6d1c41ea28e', 'request_id': 'req-38ea679b-f353-443e-b3b7-5a16ebc22bf3'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.633228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] The token cache is being invalidate because project db5fb8ab07294518a96db6d1c41ea28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:52.633704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.634361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.636259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 975/1951] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:52 2021] DELETE /identity/v3/projects/db5fb8ab07294518a96db6d1c41ea28e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:52.644805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae83bc-d5f6-4d40-9b74-97191d7f6eb4 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:52.663390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae83bc-d5f6-4d40-9b74-97191d7f6eb4 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:52.747579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:52.748614 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:52.749150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:52.749688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] PATH_INFO: `/v3/users/47a4a12d24cd4d9c9896c7d61dc96c29` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:52.751374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a4a12d24cd4d9c9896c7d61dc96c29)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:52.806344 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:52.873815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a4a12d24cd4d9c9896c7d61dc96c29'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.894079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a4a12d24cd4d9c9896c7d61dc96c29'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.894891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a4a12d24cd4d9c9896c7d61dc96c29'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.905412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a4a12d24cd4d9c9896c7d61dc96c29'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.915162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1a201c65-2a5f-47f3-9d51-3ae1ba5da6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a4a12d24cd4d9c9896c7d61dc96c29'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:52.925949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 977/1952] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:52 2021] DELETE /identity/v3/users/47a4a12d24cd4d9c9896c7d61dc96c29 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:53.294169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:53.295595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:53.308216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea679b-f353-443e-b3b7-5a16ebc22bf3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:53.372930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:53.373642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:53.373935 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:53.374216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] PATH_INFO: `/v3/projects/c2c1d6d73a5d4be098fd214c2081d058` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:53.375302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c1d6d73a5d4be098fd214c2081d058)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:53.401420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:53.451006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c1d6d73a5d4be098fd214c2081d058', 'request_id': 'req-dfc5481f-1608-4f5c-833f-8fe1b34b604d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:53.462233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c1d6d73a5d4be098fd214c2081d058', 'request_id': 'req-dfc5481f-1608-4f5c-833f-8fe1b34b604d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:53.469303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c1d6d73a5d4be098fd214c2081d058', 'request_id': 'req-dfc5481f-1608-4f5c-833f-8fe1b34b604d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:53.479620 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] The token cache is being invalidate because project c2c1d6d73a5d4be098fd214c2081d058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:53.479879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:53.480490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dfc5481f-1608-4f5c-833f-8fe1b34b604d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:53.481894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 976/1953] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:53 2021] DELETE /identity/v3/projects/c2c1d6d73a5d4be098fd214c2081d058 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:53.487797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120a747-9dd2-4a2b-9205-94d29cc7dffe None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:53.488087 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120a747-9dd2-4a2b-9205-94d29cc7dffe None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:53.488369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120a747-9dd2-4a2b-9205-94d29cc7dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:53.510777 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0120a747-9dd2-4a2b-9205-94d29cc7dffe None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:53.511911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0120a747-9dd2-4a2b-9205-94d29cc7dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:53.581195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 978/1954] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:53.590996 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dec7b-6e00-4dfb-ac3f-31b658d33d45 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:53.591295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dec7b-6e00-4dfb-ac3f-31b658d33d45 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:53.591587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dec7b-6e00-4dfb-ac3f-31b658d33d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:53.614644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-d07dec7b-6e00-4dfb-ac3f-31b658d33d45 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:53.615806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d07dec7b-6e00-4dfb-ac3f-31b658d33d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:53.622838 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 977/1955] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:53.627129 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120a747-9dd2-4a2b-9205-94d29cc7dffe None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:53.636378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120a747-9dd2-4a2b-9205-94d29cc7dffe None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:53.640582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482862e-c199-4061-88dc-25f456f0684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:53.641173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482862e-c199-4061-88dc-25f456f0684e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:53.641463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482862e-c199-4061-88dc-25f456f0684e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:53.641749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482862e-c199-4061-88dc-25f456f0684e admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:53.642464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482862e-c199-4061-88dc-25f456f0684e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:53.642800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482862e-c199-4061-88dc-25f456f0684e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:53.668891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482862e-c199-4061-88dc-25f456f0684e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:53.681935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 979/1956] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:12:53.686301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dec7b-6e00-4dfb-ac3f-31b658d33d45 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:53.695206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dec7b-6e00-4dfb-ac3f-31b658d33d45 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:53.699470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644bf4-828b-4a62-ad3e-549de9ac2c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:53.700057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644bf4-828b-4a62-ad3e-549de9ac2c77 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:53.700341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644bf4-828b-4a62-ad3e-549de9ac2c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:53.700630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644bf4-828b-4a62-ad3e-549de9ac2c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:53.701265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644bf4-828b-4a62-ad3e-549de9ac2c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:53.727864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644bf4-828b-4a62-ad3e-549de9ac2c77 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:53.755966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 978/1957] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:53 2021] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:53.759913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482862e-c199-4061-88dc-25f456f0684e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:53.769728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482862e-c199-4061-88dc-25f456f0684e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:53.832803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a59890-4d69-42b6-84b3-d1d202aa86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:53.834046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a59890-4d69-42b6-84b3-d1d202aa86b8 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:53.834333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a59890-4d69-42b6-84b3-d1d202aa86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:53.834636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a59890-4d69-42b6-84b3-d1d202aa86b8 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:53.835285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a59890-4d69-42b6-84b3-d1d202aa86b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:53.861574 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a59890-4d69-42b6-84b3-d1d202aa86b8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:53.882559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 980/1958] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:53 2021] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:53.887170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644bf4-828b-4a62-ad3e-549de9ac2c77 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:53.898376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644bf4-828b-4a62-ad3e-549de9ac2c77 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:53.902636 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0582f-9665-46b1-83b0-2549c1939035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:53.903247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0582f-9665-46b1-83b0-2549c1939035 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:53.903533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0582f-9665-46b1-83b0-2549c1939035 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:53.903813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0582f-9665-46b1-83b0-2549c1939035 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:53.904526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0582f-9665-46b1-83b0-2549c1939035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:53.930307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0582f-9665-46b1-83b0-2549c1939035 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:53.945012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 979/1959] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:53 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:53.946961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a59890-4d69-42b6-84b3-d1d202aa86b8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:53.977238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a59890-4d69-42b6-84b3-d1d202aa86b8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:53.988670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf178e-b5db-4210-b74e-472276a84200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:53.990484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf178e-b5db-4210-b74e-472276a84200 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:53.995287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf178e-b5db-4210-b74e-472276a84200 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:53.996734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf178e-b5db-4210-b74e-472276a84200 admin admin] PATH_INFO: `/v3/projects/274f78dd836a4993957d5a93ffeca1b4/users/a00b4a78510f492c802b2c32693a9bfe/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.032797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf178e-b5db-4210-b74e-472276a84200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274f78dd836a4993957d5a93ffeca1b4, user_id=a00b4a78510f492c802b2c32693a9bfe, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:54.062544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf178e-b5db-4210-b74e-472276a84200 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:54.077851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 981/1960] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:53 2021] PUT /identity/v3/projects/274f78dd836a4993957d5a93ffeca1b4/users/a00b4a78510f492c802b2c32693a9bfe/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:54.090478 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bd495-3f4c-4fac-b830-7e5ee37f9fa7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:54.090816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bd495-3f4c-4fac-b830-7e5ee37f9fa7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:54.091131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bd495-3f4c-4fac-b830-7e5ee37f9fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.128830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-062bd495-3f4c-4fac-b830-7e5ee37f9fa7 None None] MFA Rules not processed for user `a00b4a78510f492c802b2c32693a9bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:54.130603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-062bd495-3f4c-4fac-b830-7e5ee37f9fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:54.202017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 980/1961] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:54 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:54.206702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf178e-b5db-4210-b74e-472276a84200 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:54.282941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf178e-b5db-4210-b74e-472276a84200 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:54.287356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb6db-4d04-42c0-86d2-301e2ea84b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:54.287956 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb6db-4d04-42c0-86d2-301e2ea84b57 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:54.288235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb6db-4d04-42c0-86d2-301e2ea84b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:54.288521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb6db-4d04-42c0-86d2-301e2ea84b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.289151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb6db-4d04-42c0-86d2-301e2ea84b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:54.323837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb6db-4d04-42c0-86d2-301e2ea84b57 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:54.343256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 982/1962] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:54 2021] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:54.347176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bd495-3f4c-4fac-b830-7e5ee37f9fa7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:54.358288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bd495-3f4c-4fac-b830-7e5ee37f9fa7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:54.423058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4bc1a-b3ba-48ef-8c2f-d1ffe5904a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:54.423581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4bc1a-b3ba-48ef-8c2f-d1ffe5904a77 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:54.423870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4bc1a-b3ba-48ef-8c2f-d1ffe5904a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:54.424156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4bc1a-b3ba-48ef-8c2f-d1ffe5904a77 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.424996 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4bc1a-b3ba-48ef-8c2f-d1ffe5904a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:54.451894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4bc1a-b3ba-48ef-8c2f-d1ffe5904a77 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:54.472587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 981/1963] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:54 2021] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:12:54.476600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb6db-4d04-42c0-86d2-301e2ea84b57 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:54.486523 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb6db-4d04-42c0-86d2-301e2ea84b57 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:54.491899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd6ed-ddd8-47a8-8f75-63fba81a85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:54.492487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd6ed-ddd8-47a8-8f75-63fba81a85a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:54.492774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd6ed-ddd8-47a8-8f75-63fba81a85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:54.493054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd6ed-ddd8-47a8-8f75-63fba81a85a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.493771 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddd6ed-ddd8-47a8-8f75-63fba81a85a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:54.519196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddd6ed-ddd8-47a8-8f75-63fba81a85a8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:54.530391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 983/1964] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:54 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:54.534776 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4bc1a-b3ba-48ef-8c2f-d1ffe5904a77 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:54.544908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4bc1a-b3ba-48ef-8c2f-d1ffe5904a77 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:54.549176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ffc38-e3a5-4808-8f1f-2eba5496f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:54.550166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ffc38-e3a5-4808-8f1f-2eba5496f273 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:54.550464 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ffc38-e3a5-4808-8f1f-2eba5496f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:54.550784 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ffc38-e3a5-4808-8f1f-2eba5496f273 admin admin] PATH_INFO: `/v3/projects/dc4fb3a0ecfe48e482d56a9ae1aab5c9/users/756937a342414a7cb50c0da9eba33f6d/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.577736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ffc38-e3a5-4808-8f1f-2eba5496f273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4fb3a0ecfe48e482d56a9ae1aab5c9, user_id=756937a342414a7cb50c0da9eba33f6d, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:54.604155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ffc38-e3a5-4808-8f1f-2eba5496f273 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:54.618467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 982/1965] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:54 2021] PUT /identity/v3/projects/dc4fb3a0ecfe48e482d56a9ae1aab5c9/users/756937a342414a7cb50c0da9eba33f6d/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:54.622538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd6ed-ddd8-47a8-8f75-63fba81a85a8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:54.634046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd6ed-ddd8-47a8-8f75-63fba81a85a8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:54.699130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93661631-da3e-40a2-be86-f99e2def2e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:54.699782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93661631-da3e-40a2-be86-f99e2def2e3e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:54.699962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93661631-da3e-40a2-be86-f99e2def2e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:54.700252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93661631-da3e-40a2-be86-f99e2def2e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.700943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93661631-da3e-40a2-be86-f99e2def2e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:54.726705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93661631-da3e-40a2-be86-f99e2def2e3e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:54.741326 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 984/1966] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:54 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:54.742766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ffc38-e3a5-4808-8f1f-2eba5496f273 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:54.752725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ffc38-e3a5-4808-8f1f-2eba5496f273 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:54.757763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaea76-f4c1-4888-8d92-691e99ecdb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:54.758582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaea76-f4c1-4888-8d92-691e99ecdb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:54.758906 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaea76-f4c1-4888-8d92-691e99ecdb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:54.759189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaea76-f4c1-4888-8d92-691e99ecdb65 admin admin] PATH_INFO: `/v3/projects/dc4fb3a0ecfe48e482d56a9ae1aab5c9/users/756937a342414a7cb50c0da9eba33f6d/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.760957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eaea76-f4c1-4888-8d92-691e99ecdb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4fb3a0ecfe48e482d56a9ae1aab5c9, user_id=756937a342414a7cb50c0da9eba33f6d, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:54.788090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eaea76-f4c1-4888-8d92-691e99ecdb65 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:54.798405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 983/1967] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:54 2021] PUT /identity/v3/projects/dc4fb3a0ecfe48e482d56a9ae1aab5c9/users/756937a342414a7cb50c0da9eba33f6d/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:54.803024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93661631-da3e-40a2-be86-f99e2def2e3e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:54.812760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93661631-da3e-40a2-be86-f99e2def2e3e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:54.884131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2818b-fbc7-4c3d-bbb7-8e8ab5a315cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:54.884743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2818b-fbc7-4c3d-bbb7-8e8ab5a315cd admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:54.885032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2818b-fbc7-4c3d-bbb7-8e8ab5a315cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:54.885342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2818b-fbc7-4c3d-bbb7-8e8ab5a315cd admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.886005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2818b-fbc7-4c3d-bbb7-8e8ab5a315cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:54.912311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2818b-fbc7-4c3d-bbb7-8e8ab5a315cd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:54.925701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 985/1968] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:54 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:54.926931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaea76-f4c1-4888-8d92-691e99ecdb65 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:54.937093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eaea76-f4c1-4888-8d92-691e99ecdb65 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:54.941608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c3491-9069-49ed-bebc-9a5ee50551fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:54.942430 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3491-9069-49ed-bebc-9a5ee50551fd admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:54.943408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3491-9069-49ed-bebc-9a5ee50551fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:54.943652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3491-9069-49ed-bebc-9a5ee50551fd admin admin] PATH_INFO: `/v3/projects/dc4fb3a0ecfe48e482d56a9ae1aab5c9/users/756937a342414a7cb50c0da9eba33f6d/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:54.945548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c3491-9069-49ed-bebc-9a5ee50551fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4fb3a0ecfe48e482d56a9ae1aab5c9, user_id=756937a342414a7cb50c0da9eba33f6d, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:54.973315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c3491-9069-49ed-bebc-9a5ee50551fd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:54.991933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 984/1969] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:54 2021] PUT /identity/v3/projects/dc4fb3a0ecfe48e482d56a9ae1aab5c9/users/756937a342414a7cb50c0da9eba33f6d/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:55.001736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711b5a-d376-4c40-aaa6-dbf97c30ce6e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:55.002128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711b5a-d376-4c40-aaa6-dbf97c30ce6e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:55.002487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711b5a-d376-4c40-aaa6-dbf97c30ce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:55.059547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-b3711b5a-d376-4c40-aaa6-dbf97c30ce6e None None] MFA Rules not processed for user `756937a342414a7cb50c0da9eba33f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:55.060821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b3711b5a-d376-4c40-aaa6-dbf97c30ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:55.197553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 986/1970] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:55 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:55.208009 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c3491-9069-49ed-bebc-9a5ee50551fd admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:55.210812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ff3c3491-9069-49ed-bebc-9a5ee50551fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:55.336157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c3491-9069-49ed-bebc-9a5ee50551fd admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:55.340514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45674-710d-472f-9f9d-d6aa6207a762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:55.341114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45674-710d-472f-9f9d-d6aa6207a762 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:55.341407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45674-710d-472f-9f9d-d6aa6207a762 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:55.341689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45674-710d-472f-9f9d-d6aa6207a762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:55.359487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45674-710d-472f-9f9d-d6aa6207a762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:55.402222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45674-710d-472f-9f9d-d6aa6207a762 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:55.415789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 985/1971] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:55 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:55.600418 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711b5a-d376-4c40-aaa6-dbf97c30ce6e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:55.621085 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711b5a-d376-4c40-aaa6-dbf97c30ce6e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:55.632226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04462-ce21-46e6-a466-88f83a8bd81e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:55.632839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04462-ce21-46e6-a466-88f83a8bd81e service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:55.633132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04462-ce21-46e6-a466-88f83a8bd81e service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:55.633416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04462-ce21-46e6-a466-88f83a8bd81e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:55.684215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45674-710d-472f-9f9d-d6aa6207a762 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:55.685654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-54e45674-710d-472f-9f9d-d6aa6207a762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:55.697951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45674-710d-472f-9f9d-d6aa6207a762 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:55.711856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb63460-582b-4697-8e94-19c698063312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:55.713273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb63460-582b-4697-8e94-19c698063312 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:55.714535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb63460-582b-4697-8e94-19c698063312 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:55.715629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04462-ce21-46e6-a466-88f83a8bd81e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:55.716664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb63460-582b-4697-8e94-19c698063312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:55.720585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-acb63460-582b-4697-8e94-19c698063312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:55.750320 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04462-ce21-46e6-a466-88f83a8bd81e service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:55.762456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 987/1972] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:55 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:55.842702 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb63460-582b-4697-8e94-19c698063312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:55.874736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb63460-582b-4697-8e94-19c698063312 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:55.890602 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 986/1973] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:55 2021] GET /identity/v3/auth/tokens => generated 3749 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:12:56.214529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04462-ce21-46e6-a466-88f83a8bd81e service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:56.303473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04462-ce21-46e6-a466-88f83a8bd81e service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:56.308022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:56.308661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:56.309066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:56.309512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] PATH_INFO: `/v3/users/a00b4a78510f492c802b2c32693a9bfe` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:56.311097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00b4a78510f492c802b2c32693a9bfe)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:56.342686 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:56.409742 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00b4a78510f492c802b2c32693a9bfe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:56.425046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00b4a78510f492c802b2c32693a9bfe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:56.425895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00b4a78510f492c802b2c32693a9bfe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:56.434669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00b4a78510f492c802b2c32693a9bfe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:56.446463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00b4a78510f492c802b2c32693a9bfe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:56.456613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 988/1974] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:56 2021] DELETE /identity/v3/users/a00b4a78510f492c802b2c32693a9bfe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:56.458132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a1987-5d5f-4b76-8ba1-99c20fb7fa27 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:56.459285 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a1987-5d5f-4b76-8ba1-99c20fb7fa27 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:56.459381 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a1987-5d5f-4b76-8ba1-99c20fb7fa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:56.485793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-960a1987-5d5f-4b76-8ba1-99c20fb7fa27 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:56.487231 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-960a1987-5d5f-4b76-8ba1-99c20fb7fa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:56.559079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 987/1975] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:56.570035 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:56.572243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:56.657177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd070e-67f1-46a2-bcb5-4b46ac451dd5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:56.659055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02455ba8-a985-43fe-aeb5-e2f56fef70c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:56.660282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02455ba8-a985-43fe-aeb5-e2f56fef70c6 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:56.660986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02455ba8-a985-43fe-aeb5-e2f56fef70c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:56.660986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02455ba8-a985-43fe-aeb5-e2f56fef70c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:56.672465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02455ba8-a985-43fe-aeb5-e2f56fef70c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:56.701596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02455ba8-a985-43fe-aeb5-e2f56fef70c6 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:56.715773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 989/1976] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:12:57.109737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a1987-5d5f-4b76-8ba1-99c20fb7fa27 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:57.111111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-960a1987-5d5f-4b76-8ba1-99c20fb7fa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:57.122254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a1987-5d5f-4b76-8ba1-99c20fb7fa27 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:57.126810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:57.127563 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:57.127854 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:57.128197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] PATH_INFO: `/v3/projects/274f78dd836a4993957d5a93ffeca1b4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:57.129225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=274f78dd836a4993957d5a93ffeca1b4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:57.156023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:57.206291 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274f78dd836a4993957d5a93ffeca1b4', 'request_id': 'req-24ef30b9-f026-4117-b179-24e9962e0a7d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.217811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274f78dd836a4993957d5a93ffeca1b4', 'request_id': 'req-24ef30b9-f026-4117-b179-24e9962e0a7d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.224987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274f78dd836a4993957d5a93ffeca1b4', 'request_id': 'req-24ef30b9-f026-4117-b179-24e9962e0a7d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.234775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] The token cache is being invalidate because project 274f78dd836a4993957d5a93ffeca1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:57.235056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.235638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.237321 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 988/1977] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:57 2021] DELETE /identity/v3/projects/274f78dd836a4993957d5a93ffeca1b4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:57.241930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02455ba8-a985-43fe-aeb5-e2f56fef70c6 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:57.251758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02455ba8-a985-43fe-aeb5-e2f56fef70c6 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:57.316612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:57.317506 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:57.318456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:57.319000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] PATH_INFO: `/v3/users/756937a342414a7cb50c0da9eba33f6d` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:57.320263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756937a342414a7cb50c0da9eba33f6d)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:57.345805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:57.393898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756937a342414a7cb50c0da9eba33f6d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.405787 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756937a342414a7cb50c0da9eba33f6d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.406424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756937a342414a7cb50c0da9eba33f6d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.414285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756937a342414a7cb50c0da9eba33f6d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.421462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-de94b115-558d-4037-b6b7-27da3e28c0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756937a342414a7cb50c0da9eba33f6d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.428500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 990/1978] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:12:57 2021] DELETE /identity/v3/users/756937a342414a7cb50c0da9eba33f6d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:57.799174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:57.800808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:57.822537 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef30b9-f026-4117-b179-24e9962e0a7d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:57.885769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:57.886565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:57.886894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:57.887181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] PATH_INFO: `/v3/projects/dc4fb3a0ecfe48e482d56a9ae1aab5c9` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:57.888255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc4fb3a0ecfe48e482d56a9ae1aab5c9)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:57.914383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:57.967554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4fb3a0ecfe48e482d56a9ae1aab5c9', 'request_id': 'req-23213514-3124-4b97-a024-299041a9b5c0'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.979538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4fb3a0ecfe48e482d56a9ae1aab5c9', 'request_id': 'req-23213514-3124-4b97-a024-299041a9b5c0'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.987184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4fb3a0ecfe48e482d56a9ae1aab5c9', 'request_id': 'req-23213514-3124-4b97-a024-299041a9b5c0'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.998822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] The token cache is being invalidate because project dc4fb3a0ecfe48e482d56a9ae1aab5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:12:57.999110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:57.999716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-23213514-3124-4b97-a024-299041a9b5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:12:58.001393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 989/1979] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:12:57 2021] DELETE /identity/v3/projects/dc4fb3a0ecfe48e482d56a9ae1aab5c9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:58.007805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f0f91-a701-4804-8a9e-1e5ffef25032 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.008271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f0f91-a701-4804-8a9e-1e5ffef25032 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.008404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f0f91-a701-4804-8a9e-1e5ffef25032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.031611 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-b51f0f91-a701-4804-8a9e-1e5ffef25032 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:58.033069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b51f0f91-a701-4804-8a9e-1e5ffef25032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:58.102958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 991/1980] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:12:58.110455 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459e5e-ae50-426e-845d-473775fa7066 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.110893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459e5e-ae50-426e-845d-473775fa7066 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.111251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05459e5e-ae50-426e-845d-473775fa7066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.136311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-05459e5e-ae50-426e-845d-473775fa7066 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:58.137599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-05459e5e-ae50-426e-845d-473775fa7066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:58.144850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 990/1981] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:58.149309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f0f91-a701-4804-8a9e-1e5ffef25032 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:58.158858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f0f91-a701-4804-8a9e-1e5ffef25032 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:58.163458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251e653-3e97-42c1-aa68-66683c133c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:58.164137 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e653-3e97-42c1-aa68-66683c133c69 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.164490 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e653-3e97-42c1-aa68-66683c133c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.164704 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e653-3e97-42c1-aa68-66683c133c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.165420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251e653-3e97-42c1-aa68-66683c133c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:12:58.165728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251e653-3e97-42c1-aa68-66683c133c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:58.191639 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251e653-3e97-42c1-aa68-66683c133c69 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:58.206002 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 992/1982] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:12:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:12:58.210428 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05459e5e-ae50-426e-845d-473775fa7066 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:58.219241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05459e5e-ae50-426e-845d-473775fa7066 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:58.223440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593487a-635f-4b02-8c4e-ec9d98a4d4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:58.224075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593487a-635f-4b02-8c4e-ec9d98a4d4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.224368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593487a-635f-4b02-8c4e-ec9d98a4d4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.224655 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593487a-635f-4b02-8c4e-ec9d98a4d4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.225289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593487a-635f-4b02-8c4e-ec9d98a4d4e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:58.251714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593487a-635f-4b02-8c4e-ec9d98a4d4e0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:58.279658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 991/1983] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:12:58 2021] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:58.283863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251e653-3e97-42c1-aa68-66683c133c69 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:58.293487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251e653-3e97-42c1-aa68-66683c133c69 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:58.368464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162454a-6f57-4ebd-8228-7163f42fbbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:58.369012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162454a-6f57-4ebd-8228-7163f42fbbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.369354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162454a-6f57-4ebd-8228-7163f42fbbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.369647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162454a-6f57-4ebd-8228-7163f42fbbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.370285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162454a-6f57-4ebd-8228-7163f42fbbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:58.397043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162454a-6f57-4ebd-8228-7163f42fbbf3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:58.417785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 993/1984] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:12:58 2021] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:12:58.421713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593487a-635f-4b02-8c4e-ec9d98a4d4e0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:58.432192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593487a-635f-4b02-8c4e-ec9d98a4d4e0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:58.436364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874df16-b3c1-4291-b27b-d18e7f09fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:58.436959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874df16-b3c1-4291-b27b-d18e7f09fbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.437249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874df16-b3c1-4291-b27b-d18e7f09fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.437533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874df16-b3c1-4291-b27b-d18e7f09fbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.438230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874df16-b3c1-4291-b27b-d18e7f09fbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:58.463648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874df16-b3c1-4291-b27b-d18e7f09fbd9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:58.474570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 992/1985] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:12:58 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:12:58.479117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162454a-6f57-4ebd-8228-7163f42fbbf3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:58.489095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162454a-6f57-4ebd-8228-7163f42fbbf3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:58.494028 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bc68e-cec2-41b0-a11c-99a53ea3dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:58.494876 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc68e-cec2-41b0-a11c-99a53ea3dab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.495169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc68e-cec2-41b0-a11c-99a53ea3dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.495454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc68e-cec2-41b0-a11c-99a53ea3dab2 admin admin] PATH_INFO: `/v3/projects/81296579f14a4a48b8b614a1672cfdae/users/56c4ff2c5f93426bba94433463064508/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.515397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bc68e-cec2-41b0-a11c-99a53ea3dab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81296579f14a4a48b8b614a1672cfdae, user_id=56c4ff2c5f93426bba94433463064508, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:58.541739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bc68e-cec2-41b0-a11c-99a53ea3dab2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:58.557199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 994/1986] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:12:58 2021] PUT /identity/v3/projects/81296579f14a4a48b8b614a1672cfdae/users/56c4ff2c5f93426bba94433463064508/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:12:58.567660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fa36b-91a0-402a-a933-47687e82ecd3 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.567807 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fa36b-91a0-402a-a933-47687e82ecd3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.568057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fa36b-91a0-402a-a933-47687e82ecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.604298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6c8fa36b-91a0-402a-a933-47687e82ecd3 None None] MFA Rules not processed for user `56c4ff2c5f93426bba94433463064508`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:58.605442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6c8fa36b-91a0-402a-a933-47687e82ecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:58.678496 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 993/1987] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:12:58 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:58.689353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc44f0-e5a4-4c3c-a5f6-b89c8f571ad0 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.689672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc44f0-e5a4-4c3c-a5f6-b89c8f571ad0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.689960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc44f0-e5a4-4c3c-a5f6-b89c8f571ad0 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.691687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 995/1988] 10.222.0.36 () {54 vars in 956 bytes} [Wed Oct 27 14:12:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:12:58.696871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f9ce9-5dc5-4305-8ad5-28808264ddb3 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.697194 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f9ce9-5dc5-4305-8ad5-28808264ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.697477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f9ce9-5dc5-4305-8ad5-28808264ddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.719836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-622f9ce9-5dc5-4305-8ad5-28808264ddb3 None None] MFA Rules not processed for user `88ddc229d1a0446c83956f9f0c1ddbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:12:58.721012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-622f9ce9-5dc5-4305-8ad5-28808264ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:12:58.785843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 994/1989] 10.222.0.36 () {58 vars in 1053 bytes} [Wed Oct 27 14:12:58 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:12:58.793802 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc44f0-e5a4-4c3c-a5f6-b89c8f571ad0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:12:58.804627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc44f0-e5a4-4c3c-a5f6-b89c8f571ad0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:12:58.808010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518af0e3-e4ff-4a6d-b276-ff4f215d8f28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ddc229d1a0446c83956f9f0c1ddbfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:12:58.808603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518af0e3-e4ff-4a6d-b276-ff4f215d8f28 service glance] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:12:58.808894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518af0e3-e4ff-4a6d-b276-ff4f215d8f28 service glance] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:12:58.809180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518af0e3-e4ff-4a6d-b276-ff4f215d8f28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:12:58.817900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518af0e3-e4ff-4a6d-b276-ff4f215d8f28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:12:58.849515 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518af0e3-e4ff-4a6d-b276-ff4f215d8f28 service glance] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:12:58.860927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 996/1990] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:12:58 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:04.060431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f9ce9-5dc5-4305-8ad5-28808264ddb3 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:04.062531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-622f9ce9-5dc5-4305-8ad5-28808264ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:04.154050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f9ce9-5dc5-4305-8ad5-28808264ddb3 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:04.158484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:04.159350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:04.160257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:04.160257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] PATH_INFO: `/v3/users/68dec737af2c4fba8737f17e6cf45259` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:04.161397 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=68dec737af2c4fba8737f17e6cf45259)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:04.199516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:04.261324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68dec737af2c4fba8737f17e6cf45259'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:04.278158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68dec737af2c4fba8737f17e6cf45259'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:04.278971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68dec737af2c4fba8737f17e6cf45259'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:04.289297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68dec737af2c4fba8737f17e6cf45259'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:04.297379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68dec737af2c4fba8737f17e6cf45259'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:04.303248 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 995/1991] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:04 2021] DELETE /identity/v3/users/68dec737af2c4fba8737f17e6cf45259 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:04.308399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6d4f-3d5d-42a9-bcc7-f1d1bc268a9b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:04.308961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6d4f-3d5d-42a9-bcc7-f1d1bc268a9b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:04.308961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6d4f-3d5d-42a9-bcc7-f1d1bc268a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:04.337171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8c5c6d4f-3d5d-42a9-bcc7-f1d1bc268a9b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:04.338345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8c5c6d4f-3d5d-42a9-bcc7-f1d1bc268a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:04.412633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 997/1992] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:04.423799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:04.425519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:04.508272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145d991-fec2-460d-b5c0-1022332e15fa admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:04.512269 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839fd9d-0bba-48ee-89e4-00ebf952b240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:04.513002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839fd9d-0bba-48ee-89e4-00ebf952b240 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:04.513299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839fd9d-0bba-48ee-89e4-00ebf952b240 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:04.513584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839fd9d-0bba-48ee-89e4-00ebf952b240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:04.528252 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839fd9d-0bba-48ee-89e4-00ebf952b240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:04.558953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839fd9d-0bba-48ee-89e4-00ebf952b240 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:04.571037 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 996/1993] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:04.962127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c6d4f-3d5d-42a9-bcc7-f1d1bc268a9b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:04.963589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8c5c6d4f-3d5d-42a9-bcc7-f1d1bc268a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:04.975480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c6d4f-3d5d-42a9-bcc7-f1d1bc268a9b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:04.981405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:04.993169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:04.993538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:04.993935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] PATH_INFO: `/v3/projects/ee25e97ab6e24a11a24419e6efb65aba` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:04.995420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee25e97ab6e24a11a24419e6efb65aba)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:05.030468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:05.103486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee25e97ab6e24a11a24419e6efb65aba', 'request_id': 'req-24be516d-6193-4f95-bd73-98757890340a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.115614 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee25e97ab6e24a11a24419e6efb65aba', 'request_id': 'req-24be516d-6193-4f95-bd73-98757890340a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.123524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee25e97ab6e24a11a24419e6efb65aba', 'request_id': 'req-24be516d-6193-4f95-bd73-98757890340a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.133689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] The token cache is being invalidate because project ee25e97ab6e24a11a24419e6efb65aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:05.133982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.134599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.136053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 998/1994] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:04 2021] DELETE /identity/v3/projects/ee25e97ab6e24a11a24419e6efb65aba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:05.140071 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839fd9d-0bba-48ee-89e4-00ebf952b240 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:05.151683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839fd9d-0bba-48ee-89e4-00ebf952b240 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:05.226076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:05.226932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:05.227224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:05.227503 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] PATH_INFO: `/v3/users/7b37238935d54e208c6e03b38e005270` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:05.228799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b37238935d54e208c6e03b38e005270)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:05.255573 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:05.333942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b37238935d54e208c6e03b38e005270'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.349155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b37238935d54e208c6e03b38e005270'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.350505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b37238935d54e208c6e03b38e005270'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.365668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b37238935d54e208c6e03b38e005270'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.378769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-062efa01-b999-4644-ad12-f0887fa98608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b37238935d54e208c6e03b38e005270'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:05.390001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 997/1995] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:05 2021] DELETE /identity/v3/users/7b37238935d54e208c6e03b38e005270 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:05.963545 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:05.964953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:06.001590 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be516d-6193-4f95-bd73-98757890340a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:06.089777 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:06.090824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.091121 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.091412 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] PATH_INFO: `/v3/projects/398aa1e62d9040dca91e28f506f02412` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.092513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=398aa1e62d9040dca91e28f506f02412)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:06.120617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:06.170710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398aa1e62d9040dca91e28f506f02412', 'request_id': 'req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:06.182597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398aa1e62d9040dca91e28f506f02412', 'request_id': 'req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:06.189778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398aa1e62d9040dca91e28f506f02412', 'request_id': 'req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:06.204280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] The token cache is being invalidate because project 398aa1e62d9040dca91e28f506f02412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:06.204280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:06.204280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0f1701d5-bfca-454e-a02f-a5ed0e47a1cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:06.206917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 999/1996] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:05 2021] DELETE /identity/v3/projects/398aa1e62d9040dca91e28f506f02412 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:06.214065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de74aec-cbf2-474f-be7d-23b9abed0d1b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.214604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de74aec-cbf2-474f-be7d-23b9abed0d1b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.214740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de74aec-cbf2-474f-be7d-23b9abed0d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.236981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7de74aec-cbf2-474f-be7d-23b9abed0d1b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:06.238132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7de74aec-cbf2-474f-be7d-23b9abed0d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:06.303880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 998/1997] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:06.347916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ccd3c-abb1-46b7-a54f-5602dbb69717 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.348214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ccd3c-abb1-46b7-a54f-5602dbb69717 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.348511 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ccd3c-abb1-46b7-a54f-5602dbb69717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.373512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6b9ccd3c-abb1-46b7-a54f-5602dbb69717 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:06.374571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6b9ccd3c-abb1-46b7-a54f-5602dbb69717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:06.382160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1000/1998] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:06.386446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de74aec-cbf2-474f-be7d-23b9abed0d1b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:06.395791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de74aec-cbf2-474f-be7d-23b9abed0d1b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:06.400150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea7580-2668-4603-90e2-ddc911646407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:06.400736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7580-2668-4603-90e2-ddc911646407 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.401023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7580-2668-4603-90e2-ddc911646407 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.401303 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7580-2668-4603-90e2-ddc911646407 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.401989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea7580-2668-4603-90e2-ddc911646407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:06.402288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea7580-2668-4603-90e2-ddc911646407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:06.427789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea7580-2668-4603-90e2-ddc911646407 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:06.440438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 999/1999] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:06.445457 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ccd3c-abb1-46b7-a54f-5602dbb69717 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:06.454276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ccd3c-abb1-46b7-a54f-5602dbb69717 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:06.458550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d659f-eea0-45a7-9822-f2a8436cc10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:06.459290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d659f-eea0-45a7-9822-f2a8436cc10f admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.459583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d659f-eea0-45a7-9822-f2a8436cc10f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.459886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d659f-eea0-45a7-9822-f2a8436cc10f admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.460532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d659f-eea0-45a7-9822-f2a8436cc10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:06.486896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d659f-eea0-45a7-9822-f2a8436cc10f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:06.516079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1001/2000] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:06 2021] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:06.520224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea7580-2668-4603-90e2-ddc911646407 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:06.530008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea7580-2668-4603-90e2-ddc911646407 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:06.593694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743d57-a498-4fda-acc0-ed8cb71d0fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:06.594296 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743d57-a498-4fda-acc0-ed8cb71d0fcf admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.594580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743d57-a498-4fda-acc0-ed8cb71d0fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.594895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743d57-a498-4fda-acc0-ed8cb71d0fcf admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.595518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5743d57-a498-4fda-acc0-ed8cb71d0fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:06.623115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5743d57-a498-4fda-acc0-ed8cb71d0fcf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:06.645823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1000/2001] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:06 2021] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:06.647328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d659f-eea0-45a7-9822-f2a8436cc10f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:06.658198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d659f-eea0-45a7-9822-f2a8436cc10f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:06.663323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4c3fa-1b87-417d-913e-080a91f6f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:06.663948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4c3fa-1b87-417d-913e-080a91f6f503 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.664366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4c3fa-1b87-417d-913e-080a91f6f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.664657 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4c3fa-1b87-417d-913e-080a91f6f503 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.665364 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4c3fa-1b87-417d-913e-080a91f6f503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:06.692663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4c3fa-1b87-417d-913e-080a91f6f503 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:06.706528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1002/2002] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:06 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:13:06.707824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743d57-a498-4fda-acc0-ed8cb71d0fcf admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:06.717254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743d57-a498-4fda-acc0-ed8cb71d0fcf admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:06.722794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69bde8-b8e9-4828-87ce-5bee9b493e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:06.723612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69bde8-b8e9-4828-87ce-5bee9b493e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.723898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69bde8-b8e9-4828-87ce-5bee9b493e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.724771 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69bde8-b8e9-4828-87ce-5bee9b493e3f admin admin] PATH_INFO: `/v3/projects/444fc4a9deaa4ee699178617bffa4222/users/7eb13a0870fa46d08753632ef2ddb046/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.749325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69bde8-b8e9-4828-87ce-5bee9b493e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=444fc4a9deaa4ee699178617bffa4222, user_id=7eb13a0870fa46d08753632ef2ddb046, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:06.779011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69bde8-b8e9-4828-87ce-5bee9b493e3f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:06.796263 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1001/2003] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:06 2021] PUT /identity/v3/projects/444fc4a9deaa4ee699178617bffa4222/users/7eb13a0870fa46d08753632ef2ddb046/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:06.806677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a43b4d-73e6-491e-87c1-476bcaf88352 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.807064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a43b4d-73e6-491e-87c1-476bcaf88352 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.807421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a43b4d-73e6-491e-87c1-476bcaf88352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.848618 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c6a43b4d-73e6-491e-87c1-476bcaf88352 None None] MFA Rules not processed for user `7eb13a0870fa46d08753632ef2ddb046`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:06.849850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c6a43b4d-73e6-491e-87c1-476bcaf88352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:06.858279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69bde8-b8e9-4828-87ce-5bee9b493e3f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:06.860169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9c69bde8-b8e9-4828-87ce-5bee9b493e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:06.926966 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1003/2004] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:06 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:06.931562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a43b4d-73e6-491e-87c1-476bcaf88352 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:06.938339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69bde8-b8e9-4828-87ce-5bee9b493e3f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:06.941188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a43b4d-73e6-491e-87c1-476bcaf88352 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:06.942735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:06.946849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.946849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.947071 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] PATH_INFO: `/v3/users/7700bc784b644c59884f489c2ae612e3` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.947933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87047a0-8f7c-422a-9ac5-a2fb78813e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:06.948595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87047a0-8f7c-422a-9ac5-a2fb78813e13 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:06.948987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87047a0-8f7c-422a-9ac5-a2fb78813e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:06.949480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87047a0-8f7c-422a-9ac5-a2fb78813e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:06.950512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87047a0-8f7c-422a-9ac5-a2fb78813e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:06.951252 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7700bc784b644c59884f489c2ae612e3)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:06.977720 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:06.978065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87047a0-8f7c-422a-9ac5-a2fb78813e13 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.007570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1004/2005] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:06 2021] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:07.011202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87047a0-8f7c-422a-9ac5-a2fb78813e13 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.040227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7700bc784b644c59884f489c2ae612e3'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.059039 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7700bc784b644c59884f489c2ae612e3'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.059783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7700bc784b644c59884f489c2ae612e3'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.070982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7700bc784b644c59884f489c2ae612e3'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.080739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-683fb4d2-925c-485e-883d-16e5a0d661a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7700bc784b644c59884f489c2ae612e3'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.100656 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1002/2006] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:06 2021] DELETE /identity/v3/users/7700bc784b644c59884f489c2ae612e3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:07.105680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df1e0b-9b6e-4b87-be77-f3b83c5f3dfc None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.106379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df1e0b-9b6e-4b87-be77-f3b83c5f3dfc None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.106754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df1e0b-9b6e-4b87-be77-f3b83c5f3dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.123931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87047a0-8f7c-422a-9ac5-a2fb78813e13 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:07.134050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a0df1e0b-9b6e-4b87-be77-f3b83c5f3dfc None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:07.135289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a0df1e0b-9b6e-4b87-be77-f3b83c5f3dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:07.213527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbc3d5-5676-4dea-9c1e-46cbd085edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:07.214147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbc3d5-5676-4dea-9c1e-46cbd085edb8 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.214586 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbc3d5-5676-4dea-9c1e-46cbd085edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.217902 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1003/2007] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:07.218354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbc3d5-5676-4dea-9c1e-46cbd085edb8 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.218354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbc3d5-5676-4dea-9c1e-46cbd085edb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:07.225801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df1e0b-9b6e-4b87-be77-f3b83c5f3dfc None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.227134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a0df1e0b-9b6e-4b87-be77-f3b83c5f3dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:07.242900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbc3d5-5676-4dea-9c1e-46cbd085edb8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.266125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1005/2008] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:07 2021] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:07.270676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbc3d5-5676-4dea-9c1e-46cbd085edb8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.274150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-39fbc3d5-5676-4dea-9c1e-46cbd085edb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:07.288736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbc3d5-5676-4dea-9c1e-46cbd085edb8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:07.293703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddc2b6-a307-4fed-8710-c791ecbef8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:07.294912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddc2b6-a307-4fed-8710-c791ecbef8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.294912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddc2b6-a307-4fed-8710-c791ecbef8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.295108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddc2b6-a307-4fed-8710-c791ecbef8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.296121 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddc2b6-a307-4fed-8710-c791ecbef8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:07.318288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df1e0b-9b6e-4b87-be77-f3b83c5f3dfc None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:07.320266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6d82e-3282-4b39-8d65-c8c0539eb4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:07.321016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6d82e-3282-4b39-8d65-c8c0539eb4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.321305 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6d82e-3282-4b39-8d65-c8c0539eb4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.322206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6d82e-3282-4b39-8d65-c8c0539eb4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.330666 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddc2b6-a307-4fed-8710-c791ecbef8d4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.332930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6d82e-3282-4b39-8d65-c8c0539eb4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:07.342700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1006/2009] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:07 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:07.346221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddc2b6-a307-4fed-8710-c791ecbef8d4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.360448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddc2b6-a307-4fed-8710-c791ecbef8d4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:07.361008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6d82e-3282-4b39-8d65-c8c0539eb4f8 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.366029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1adb21-5563-43b2-84a0-1b6b7eeb29c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:07.367132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1adb21-5563-43b2-84a0-1b6b7eeb29c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.367683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1adb21-5563-43b2-84a0-1b6b7eeb29c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.368067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1adb21-5563-43b2-84a0-1b6b7eeb29c9 admin admin] PATH_INFO: `/v3/projects/103ef5ff38774a6fa59ed272fd9418c4/users/61bec4c0c7274e95a12c33605c97aa4c/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.372170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1004/2010] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:07.392101 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1adb21-5563-43b2-84a0-1b6b7eeb29c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103ef5ff38774a6fa59ed272fd9418c4, user_id=61bec4c0c7274e95a12c33605c97aa4c, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:07.424356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1adb21-5563-43b2-84a0-1b6b7eeb29c9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.443468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1007/2011] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:07 2021] PUT /identity/v3/projects/103ef5ff38774a6fa59ed272fd9418c4/users/61bec4c0c7274e95a12c33605c97aa4c/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:07.448040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6d82e-3282-4b39-8d65-c8c0539eb4f8 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.459379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6d82e-3282-4b39-8d65-c8c0539eb4f8 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:07.539370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745ae81-c5d9-4b09-bca8-e850fad49678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:07.540119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745ae81-c5d9-4b09-bca8-e850fad49678 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.540423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745ae81-c5d9-4b09-bca8-e850fad49678 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.540700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745ae81-c5d9-4b09-bca8-e850fad49678 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.541456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745ae81-c5d9-4b09-bca8-e850fad49678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:07.568619 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745ae81-c5d9-4b09-bca8-e850fad49678 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.582762 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1005/2012] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:07 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:13:07.584797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1adb21-5563-43b2-84a0-1b6b7eeb29c9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.596165 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1adb21-5563-43b2-84a0-1b6b7eeb29c9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:07.603230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34437-d36c-4ccb-9fbc-8f8c25b814b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:07.604077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34437-d36c-4ccb-9fbc-8f8c25b814b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.604372 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34437-d36c-4ccb-9fbc-8f8c25b814b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.604659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34437-d36c-4ccb-9fbc-8f8c25b814b7 admin admin] PATH_INFO: `/v3/projects/103ef5ff38774a6fa59ed272fd9418c4/users/61bec4c0c7274e95a12c33605c97aa4c/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.606525 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34437-d36c-4ccb-9fbc-8f8c25b814b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103ef5ff38774a6fa59ed272fd9418c4, user_id=61bec4c0c7274e95a12c33605c97aa4c, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:07.634180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34437-d36c-4ccb-9fbc-8f8c25b814b7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.645194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1008/2013] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:07 2021] PUT /identity/v3/projects/103ef5ff38774a6fa59ed272fd9418c4/users/61bec4c0c7274e95a12c33605c97aa4c/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:07.649789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745ae81-c5d9-4b09-bca8-e850fad49678 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.659453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745ae81-c5d9-4b09-bca8-e850fad49678 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:07.726367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22b66c-87b2-483c-ae33-647614203893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:07.727101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22b66c-87b2-483c-ae33-647614203893 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.727399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22b66c-87b2-483c-ae33-647614203893 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.727684 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22b66c-87b2-483c-ae33-647614203893 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.728378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22b66c-87b2-483c-ae33-647614203893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:07.757410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22b66c-87b2-483c-ae33-647614203893 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.767636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34437-d36c-4ccb-9fbc-8f8c25b814b7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.769645 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1006/2014] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:07 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:07.773724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-98b34437-d36c-4ccb-9fbc-8f8c25b814b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:07.774226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22b66c-87b2-483c-ae33-647614203893 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.784227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22b66c-87b2-483c-ae33-647614203893 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:07.786751 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34437-d36c-4ccb-9fbc-8f8c25b814b7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:07.788786 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87e990-089d-42ad-aebf-1d9cea715a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:07.789653 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87e990-089d-42ad-aebf-1d9cea715a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.790070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87e990-089d-42ad-aebf-1d9cea715a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.790358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87e990-089d-42ad-aebf-1d9cea715a7e admin admin] PATH_INFO: `/v3/projects/103ef5ff38774a6fa59ed272fd9418c4/users/61bec4c0c7274e95a12c33605c97aa4c/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.791289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:07.792080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.792218 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87e990-089d-42ad-aebf-1d9cea715a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=103ef5ff38774a6fa59ed272fd9418c4, user_id=61bec4c0c7274e95a12c33605c97aa4c, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:07.792372 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.792660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] PATH_INFO: `/v3/projects/90824cc947bc498bb75761a071ff48dd` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.794018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=90824cc947bc498bb75761a071ff48dd)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:07.820203 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87e990-089d-42ad-aebf-1d9cea715a7e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.820873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:07.833621 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1007/2015] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:07 2021] PUT /identity/v3/projects/103ef5ff38774a6fa59ed272fd9418c4/users/61bec4c0c7274e95a12c33605c97aa4c/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:07.843346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be333-bf05-4740-8332-2d9fa7259661 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.843638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be333-bf05-4740-8332-2d9fa7259661 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.843926 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be333-bf05-4740-8332-2d9fa7259661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.879266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90824cc947bc498bb75761a071ff48dd', 'request_id': 'req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.882695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ee1be333-bf05-4740-8332-2d9fa7259661 None None] MFA Rules not processed for user `61bec4c0c7274e95a12c33605c97aa4c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:07.883840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ee1be333-bf05-4740-8332-2d9fa7259661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:07.892739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90824cc947bc498bb75761a071ff48dd', 'request_id': 'req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.900201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90824cc947bc498bb75761a071ff48dd', 'request_id': 'req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.910913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] The token cache is being invalidate because project 90824cc947bc498bb75761a071ff48dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:07.911273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.911994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-7087c31a-c0ee-4e0f-b76f-ba939b53af5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:07.913644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1009/2016] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:07 2021] DELETE /identity/v3/projects/90824cc947bc498bb75761a071ff48dd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:07.919864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ef78c-311d-400e-b0be-96c2f4a49739 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:07.921019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ef78c-311d-400e-b0be-96c2f4a49739 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:07.921716 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ef78c-311d-400e-b0be-96c2f4a49739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:07.948512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-132ef78c-311d-400e-b0be-96c2f4a49739 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:07.949804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-132ef78c-311d-400e-b0be-96c2f4a49739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:07.975814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1008/2017] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:07 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:07.986257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1be333-bf05-4740-8332-2d9fa7259661 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:07.987802 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ee1be333-bf05-4740-8332-2d9fa7259661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:08.020688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1010/2018] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:08.029407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd384d-f54a-48d0-abbb-e254536322f7 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.029790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd384d-f54a-48d0-abbb-e254536322f7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.030038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd384d-f54a-48d0-abbb-e254536322f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.054183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1cdd384d-f54a-48d0-abbb-e254536322f7 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:08.055356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1cdd384d-f54a-48d0-abbb-e254536322f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:08.069203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1011/2019] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:08.070369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd384d-f54a-48d0-abbb-e254536322f7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:08.078598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1be333-bf05-4740-8332-2d9fa7259661 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:08.079248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd384d-f54a-48d0-abbb-e254536322f7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:08.083482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28337da0-c385-4d42-bcbf-83dbcdb8801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:08.084841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337da0-c385-4d42-bcbf-83dbcdb8801e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.085187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337da0-c385-4d42-bcbf-83dbcdb8801e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.085408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337da0-c385-4d42-bcbf-83dbcdb8801e admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.086100 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28337da0-c385-4d42-bcbf-83dbcdb8801e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:08.086394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28337da0-c385-4d42-bcbf-83dbcdb8801e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:08.086511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2573e-ae37-49df-b40e-8ac8a41a21b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:08.087340 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2573e-ae37-49df-b40e-8ac8a41a21b1 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.087627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2573e-ae37-49df-b40e-8ac8a41a21b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.087906 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2573e-ae37-49df-b40e-8ac8a41a21b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.097627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2573e-ae37-49df-b40e-8ac8a41a21b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:08.112808 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28337da0-c385-4d42-bcbf-83dbcdb8801e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:08.124894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2573e-ae37-49df-b40e-8ac8a41a21b1 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:08.127595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1012/2020] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:08.131933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28337da0-c385-4d42-bcbf-83dbcdb8801e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:08.136198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1009/2021] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:07 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:08.141830 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28337da0-c385-4d42-bcbf-83dbcdb8801e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:08.147318 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741209b-e3b1-4231-9a79-b674dda7f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:08.147916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741209b-e3b1-4231-9a79-b674dda7f737 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.148197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741209b-e3b1-4231-9a79-b674dda7f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.148479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741209b-e3b1-4231-9a79-b674dda7f737 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.149113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741209b-e3b1-4231-9a79-b674dda7f737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:08.162439 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2573e-ae37-49df-b40e-8ac8a41a21b1 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:08.163843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-dad2573e-ae37-49df-b40e-8ac8a41a21b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:08.176823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2573e-ae37-49df-b40e-8ac8a41a21b1 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:08.180532 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741209b-e3b1-4231-9a79-b674dda7f737 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:08.182336 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:08.183234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.183522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.183804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] PATH_INFO: `/v3/users/7eb13a0870fa46d08753632ef2ddb046` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.185018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb13a0870fa46d08753632ef2ddb046)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:08.208179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1013/2022] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:08 2021] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:08.212369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741209b-e3b1-4231-9a79-b674dda7f737 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:08.213835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:08.269808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb13a0870fa46d08753632ef2ddb046'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:08.281702 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb13a0870fa46d08753632ef2ddb046'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:08.282486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb13a0870fa46d08753632ef2ddb046'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:08.284620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741209b-e3b1-4231-9a79-b674dda7f737 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:08.289708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fc6e4-e510-4a59-b476-10a47376afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:08.290321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fc6e4-e510-4a59-b476-10a47376afab admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.290613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fc6e4-e510-4a59-b476-10a47376afab admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.290834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb13a0870fa46d08753632ef2ddb046'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:08.290939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fc6e4-e510-4a59-b476-10a47376afab admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.291561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fc6e4-e510-4a59-b476-10a47376afab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:08.298240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-dccc7db8-f4f8-404d-9429-a07905954725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb13a0870fa46d08753632ef2ddb046'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:08.304865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1010/2023] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:08 2021] DELETE /identity/v3/users/7eb13a0870fa46d08753632ef2ddb046 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:08.309272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3d88-4d87-474e-a4f5-bdf1fd91bf0f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.309573 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3d88-4d87-474e-a4f5-bdf1fd91bf0f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.309893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3d88-4d87-474e-a4f5-bdf1fd91bf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.318711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fc6e4-e510-4a59-b476-10a47376afab admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:08.334018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-358f3d88-4d87-474e-a4f5-bdf1fd91bf0f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:08.335237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-358f3d88-4d87-474e-a4f5-bdf1fd91bf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:08.340212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1014/2024] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:08 2021] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:08.344418 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fc6e4-e510-4a59-b476-10a47376afab admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:08.346016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-842fc6e4-e510-4a59-b476-10a47376afab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:08.358887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fc6e4-e510-4a59-b476-10a47376afab admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:08.409207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1011/2025] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:08.417155 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3d88-4d87-474e-a4f5-bdf1fd91bf0f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:08.418615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-358f3d88-4d87-474e-a4f5-bdf1fd91bf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:08.431249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af13cf-aeaa-4f69-bc02-4e2cd12e23ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:08.432036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af13cf-aeaa-4f69-bc02-4e2cd12e23ca admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.432334 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af13cf-aeaa-4f69-bc02-4e2cd12e23ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.432623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af13cf-aeaa-4f69-bc02-4e2cd12e23ca admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.433468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af13cf-aeaa-4f69-bc02-4e2cd12e23ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:08.458800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af13cf-aeaa-4f69-bc02-4e2cd12e23ca admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:08.469721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1015/2026] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:08 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:08.473290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af13cf-aeaa-4f69-bc02-4e2cd12e23ca admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:08.483894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af13cf-aeaa-4f69-bc02-4e2cd12e23ca admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:08.490752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038ee9a-f42c-4118-bbc9-95828f054268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:08.491655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038ee9a-f42c-4118-bbc9-95828f054268 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.491951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038ee9a-f42c-4118-bbc9-95828f054268 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.492239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038ee9a-f42c-4118-bbc9-95828f054268 admin admin] PATH_INFO: `/v3/projects/7bc6b1b4ce944be4bd2c2a4db0a3446c/users/a906ddeb796f4af5a8506572fcdfcdd8/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.492498 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3d88-4d87-474e-a4f5-bdf1fd91bf0f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:08.499789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20298bf1-8848-46cb-b966-d173c7965997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:08.500434 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298bf1-8848-46cb-b966-d173c7965997 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.500726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298bf1-8848-46cb-b966-d173c7965997 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.501005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20298bf1-8848-46cb-b966-d173c7965997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.515500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20298bf1-8848-46cb-b966-d173c7965997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:08.517492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038ee9a-f42c-4118-bbc9-95828f054268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc6b1b4ce944be4bd2c2a4db0a3446c, user_id=a906ddeb796f4af5a8506572fcdfcdd8, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:08.543680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20298bf1-8848-46cb-b966-d173c7965997 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:08.544970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038ee9a-f42c-4118-bbc9-95828f054268 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:08.554055 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1012/2027] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:08.560631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1016/2028] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:08 2021] PUT /identity/v3/projects/7bc6b1b4ce944be4bd2c2a4db0a3446c/users/a906ddeb796f4af5a8506572fcdfcdd8/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:08.570932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809d5d-7aef-4042-9015-71581c9526b4 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.571281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809d5d-7aef-4042-9015-71581c9526b4 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.571550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809d5d-7aef-4042-9015-71581c9526b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.609278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-1c809d5d-7aef-4042-9015-71581c9526b4 None None] MFA Rules not processed for user `a906ddeb796f4af5a8506572fcdfcdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:08.610469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1c809d5d-7aef-4042-9015-71581c9526b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:08.706163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1013/2029] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:08 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:08.710661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038ee9a-f42c-4118-bbc9-95828f054268 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:08.796118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038ee9a-f42c-4118-bbc9-95828f054268 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:08.801131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d458a-441f-4cbc-9c2c-69b40dcbe465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:08.802829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d458a-441f-4cbc-9c2c-69b40dcbe465 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:08.803591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d458a-441f-4cbc-9c2c-69b40dcbe465 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:08.803998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d458a-441f-4cbc-9c2c-69b40dcbe465 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:08.805042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d458a-441f-4cbc-9c2c-69b40dcbe465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:08.866283 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d458a-441f-4cbc-9c2c-69b40dcbe465 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:08.908442 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1017/2030] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:08 2021] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:08.912780 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809d5d-7aef-4042-9015-71581c9526b4 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:08.953578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809d5d-7aef-4042-9015-71581c9526b4 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:09.084226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce494d78-37de-438b-a515-6321d9b30371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:09.084922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce494d78-37de-438b-a515-6321d9b30371 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.085286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce494d78-37de-438b-a515-6321d9b30371 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.085661 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce494d78-37de-438b-a515-6321d9b30371 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.086292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce494d78-37de-438b-a515-6321d9b30371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:09.121679 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce494d78-37de-438b-a515-6321d9b30371 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:09.149894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1014/2031] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:08 2021] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:09.151394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d458a-441f-4cbc-9c2c-69b40dcbe465 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:09.153353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce494d78-37de-438b-a515-6321d9b30371 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:09.164433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ce494d78-37de-438b-a515-6321d9b30371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:09.170692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d458a-441f-4cbc-9c2c-69b40dcbe465 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:09.183641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8322f5-3c95-4965-b9ee-494a4e33b70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:09.183641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8322f5-3c95-4965-b9ee-494a4e33b70c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.183641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8322f5-3c95-4965-b9ee-494a4e33b70c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.183641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8322f5-3c95-4965-b9ee-494a4e33b70c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.184113 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce494d78-37de-438b-a515-6321d9b30371 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:09.184210 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8322f5-3c95-4965-b9ee-494a4e33b70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:09.191132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:09.191944 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.192237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.192573 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] PATH_INFO: `/v3/projects/444fc4a9deaa4ee699178617bffa4222` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.194774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444fc4a9deaa4ee699178617bffa4222)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:09.211122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8322f5-3c95-4965-b9ee-494a4e33b70c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:09.223465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1018/2032] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:09 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:09.228646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8322f5-3c95-4965-b9ee-494a4e33b70c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:09.232058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:09.242759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8322f5-3c95-4965-b9ee-494a4e33b70c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:09.247161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c1858-dc3e-499e-99bb-b551bc6d2a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:09.247987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c1858-dc3e-499e-99bb-b551bc6d2a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.248276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c1858-dc3e-499e-99bb-b551bc6d2a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.248561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c1858-dc3e-499e-99bb-b551bc6d2a4f admin admin] PATH_INFO: `/v3/projects/7496ee0d7ae240c29f93537b1d679402/users/1af4b31167494a928251faf48c15b8a7/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.268680 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c1858-dc3e-499e-99bb-b551bc6d2a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7496ee0d7ae240c29f93537b1d679402, user_id=1af4b31167494a928251faf48c15b8a7, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:09.286067 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444fc4a9deaa4ee699178617bffa4222', 'request_id': 'req-b42255d8-e6e1-4e09-a56f-c99650b2cca8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.294877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c1858-dc3e-499e-99bb-b551bc6d2a4f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:09.297675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444fc4a9deaa4ee699178617bffa4222', 'request_id': 'req-b42255d8-e6e1-4e09-a56f-c99650b2cca8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.306507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444fc4a9deaa4ee699178617bffa4222', 'request_id': 'req-b42255d8-e6e1-4e09-a56f-c99650b2cca8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.308680 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1019/2033] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:09 2021] PUT /identity/v3/projects/7496ee0d7ae240c29f93537b1d679402/users/1af4b31167494a928251faf48c15b8a7/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:09.317197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] The token cache is being invalidate because project 444fc4a9deaa4ee699178617bffa4222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:09.317493 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.322687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.322687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1015/2034] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:09 2021] DELETE /identity/v3/projects/444fc4a9deaa4ee699178617bffa4222 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:09.327779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:09.328331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5edb7a-2c86-4404-9352-7b9d40babfc9 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.328635 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5edb7a-2c86-4404-9352-7b9d40babfc9 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.328924 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5edb7a-2c86-4404-9352-7b9d40babfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.329217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:09.365446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-ef5edb7a-2c86-4404-9352-7b9d40babfc9 None None] MFA Rules not processed for user `1af4b31167494a928251faf48c15b8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:09.366675 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ef5edb7a-2c86-4404-9352-7b9d40babfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:09.406841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42255d8-e6e1-4e09-a56f-c99650b2cca8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:09.451766 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1020/2035] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:09 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:09.456301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5edb7a-2c86-4404-9352-7b9d40babfc9 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:09.457849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ef5edb7a-2c86-4404-9352-7b9d40babfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:09.492739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:09.493677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.494065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.494442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] PATH_INFO: `/v3/users/61bec4c0c7274e95a12c33605c97aa4c` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.495691 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bec4c0c7274e95a12c33605c97aa4c)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:09.523172 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:09.536028 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5edb7a-2c86-4404-9352-7b9d40babfc9 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:09.540622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d84cd-6e61-45c5-a99c-77e02ac05ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:09.541253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d84cd-6e61-45c5-a99c-77e02ac05ada admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.541543 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d84cd-6e61-45c5-a99c-77e02ac05ada admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.541827 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d84cd-6e61-45c5-a99c-77e02ac05ada admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.542465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d84cd-6e61-45c5-a99c-77e02ac05ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:09.569988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d84cd-6e61-45c5-a99c-77e02ac05ada admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:09.571793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bec4c0c7274e95a12c33605c97aa4c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.584430 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bec4c0c7274e95a12c33605c97aa4c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.585181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bec4c0c7274e95a12c33605c97aa4c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.593417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bec4c0c7274e95a12c33605c97aa4c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.602231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1021/2036] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:09 2021] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:09.603332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d84cd-6e61-45c5-a99c-77e02ac05ada admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:09.609432 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bec4c0c7274e95a12c33605c97aa4c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:09.616518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1016/2037] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:09 2021] DELETE /identity/v3/users/61bec4c0c7274e95a12c33605c97aa4c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:09.679775 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d84cd-6e61-45c5-a99c-77e02ac05ada admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:09.746226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620b701-481f-4761-b761-e7b71b8de87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:09.746872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620b701-481f-4761-b761-e7b71b8de87f admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.747195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620b701-481f-4761-b761-e7b71b8de87f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.747481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620b701-481f-4761-b761-e7b71b8de87f admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.748122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620b701-481f-4761-b761-e7b71b8de87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:09.777402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620b701-481f-4761-b761-e7b71b8de87f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:09.800535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1022/2038] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:09 2021] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:09.805036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:09.806434 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:09.839701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f289225-22d6-40f9-828f-60c4219ae047 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:09.845505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bba4a-75b5-4e91-b35a-36f3b27fb057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:09.846393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bba4a-75b5-4e91-b35a-36f3b27fb057 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.846393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bba4a-75b5-4e91-b35a-36f3b27fb057 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.846715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bba4a-75b5-4e91-b35a-36f3b27fb057 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.847526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bba4a-75b5-4e91-b35a-36f3b27fb057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:09.879413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bba4a-75b5-4e91-b35a-36f3b27fb057 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:09.893016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1017/2039] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:09 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:09.897367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620b701-481f-4761-b761-e7b71b8de87f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:09.907926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620b701-481f-4761-b761-e7b71b8de87f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:09.914565 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c6400-fbef-4869-af66-873d7e0ed5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:09.915585 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c6400-fbef-4869-af66-873d7e0ed5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:09.915979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c6400-fbef-4869-af66-873d7e0ed5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:09.916621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c6400-fbef-4869-af66-873d7e0ed5cc admin admin] PATH_INFO: `/v3/projects/d16e160370584bc0a73c518314fc12ce/users/6ed32d54156e4358a4aa1839163b9b75/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:09.945093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c6400-fbef-4869-af66-873d7e0ed5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16e160370584bc0a73c518314fc12ce, user_id=6ed32d54156e4358a4aa1839163b9b75, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:09.974473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c6400-fbef-4869-af66-873d7e0ed5cc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:09.995743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1023/2040] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:09 2021] PUT /identity/v3/projects/d16e160370584bc0a73c518314fc12ce/users/6ed32d54156e4358a4aa1839163b9b75/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:09.999311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bba4a-75b5-4e91-b35a-36f3b27fb057 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:10.013745 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bba4a-75b5-4e91-b35a-36f3b27fb057 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:10.092897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c54d9-0b78-4cc8-a6d9-fa851d40a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:10.093429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c54d9-0b78-4cc8-a6d9-fa851d40a7fe admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.093726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c54d9-0b78-4cc8-a6d9-fa851d40a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.094014 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c54d9-0b78-4cc8-a6d9-fa851d40a7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.094725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c54d9-0b78-4cc8-a6d9-fa851d40a7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:10.128822 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c54d9-0b78-4cc8-a6d9-fa851d40a7fe admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:10.142903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1018/2041] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:09 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:10.147147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c6400-fbef-4869-af66-873d7e0ed5cc admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:10.169235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c6400-fbef-4869-af66-873d7e0ed5cc admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:10.182152 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55272ea-9c01-48dc-a9aa-3ef69c573517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:10.183059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55272ea-9c01-48dc-a9aa-3ef69c573517 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.183573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55272ea-9c01-48dc-a9aa-3ef69c573517 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.183903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55272ea-9c01-48dc-a9aa-3ef69c573517 admin admin] PATH_INFO: `/v3/projects/d16e160370584bc0a73c518314fc12ce/users/6ed32d54156e4358a4aa1839163b9b75/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.186197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55272ea-9c01-48dc-a9aa-3ef69c573517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16e160370584bc0a73c518314fc12ce, user_id=6ed32d54156e4358a4aa1839163b9b75, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:10.218309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55272ea-9c01-48dc-a9aa-3ef69c573517 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:10.231281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1024/2042] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:10 2021] PUT /identity/v3/projects/d16e160370584bc0a73c518314fc12ce/users/6ed32d54156e4358a4aa1839163b9b75/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:10.237741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c54d9-0b78-4cc8-a6d9-fa851d40a7fe admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:10.249410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c54d9-0b78-4cc8-a6d9-fa851d40a7fe admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:10.300062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55272ea-9c01-48dc-a9aa-3ef69c573517 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:10.303125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f55272ea-9c01-48dc-a9aa-3ef69c573517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:10.326818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de14b58-f099-4f74-969c-945f0c8bf432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:10.327541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14b58-f099-4f74-969c-945f0c8bf432 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.327738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14b58-f099-4f74-969c-945f0c8bf432 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.328011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14b58-f099-4f74-969c-945f0c8bf432 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.328834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de14b58-f099-4f74-969c-945f0c8bf432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:10.356121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de14b58-f099-4f74-969c-945f0c8bf432 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:10.368082 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1019/2043] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:10 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:10.372150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de14b58-f099-4f74-969c-945f0c8bf432 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:10.383177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de14b58-f099-4f74-969c-945f0c8bf432 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:10.387664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78267b-0bec-4870-b559-781a62283a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:10.388557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78267b-0bec-4870-b559-781a62283a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.388920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78267b-0bec-4870-b559-781a62283a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.389300 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78267b-0bec-4870-b559-781a62283a40 admin admin] PATH_INFO: `/v3/projects/d16e160370584bc0a73c518314fc12ce/users/6ed32d54156e4358a4aa1839163b9b75/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.391167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78267b-0bec-4870-b559-781a62283a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16e160370584bc0a73c518314fc12ce, user_id=6ed32d54156e4358a4aa1839163b9b75, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:10.399371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55272ea-9c01-48dc-a9aa-3ef69c573517 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:10.410233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:10.415130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.415923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.416569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] PATH_INFO: `/v3/projects/103ef5ff38774a6fa59ed272fd9418c4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.418267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] RBAC: Authorizing `identity:delete_project(project_id=103ef5ff38774a6fa59ed272fd9418c4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:10.428829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78267b-0bec-4870-b559-781a62283a40 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:10.452740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1020/2044] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:10 2021] PUT /identity/v3/projects/d16e160370584bc0a73c518314fc12ce/users/6ed32d54156e4358a4aa1839163b9b75/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:10.454406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65e4b-4a11-4139-aaf0-fc0d4ffa5d86 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.454912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65e4b-4a11-4139-aaf0-fc0d4ffa5d86 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.455162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:10.455266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65e4b-4a11-4139-aaf0-fc0d4ffa5d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.494243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b7c65e4b-4a11-4139-aaf0-fc0d4ffa5d86 None None] MFA Rules not processed for user `6ed32d54156e4358a4aa1839163b9b75`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:10.496824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b7c65e4b-4a11-4139-aaf0-fc0d4ffa5d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:10.520120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103ef5ff38774a6fa59ed272fd9418c4', 'request_id': 'req-d79d2285-cc0d-4763-be86-1e68f317472a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:10.535151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103ef5ff38774a6fa59ed272fd9418c4', 'request_id': 'req-d79d2285-cc0d-4763-be86-1e68f317472a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:10.545006 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103ef5ff38774a6fa59ed272fd9418c4', 'request_id': 'req-d79d2285-cc0d-4763-be86-1e68f317472a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:10.558546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] The token cache is being invalidate because project 103ef5ff38774a6fa59ed272fd9418c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:10.559326 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:10.560565 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d79d2285-cc0d-4763-be86-1e68f317472a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:10.562931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1025/2045] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:10 2021] DELETE /identity/v3/projects/103ef5ff38774a6fa59ed272fd9418c4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:10.581373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b83620-49db-4480-9c3b-9cd08afc8ad8 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.582021 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b83620-49db-4480-9c3b-9cd08afc8ad8 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.582506 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b83620-49db-4480-9c3b-9cd08afc8ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.594772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1021/2046] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:10 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:10.606047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c65e4b-4a11-4139-aaf0-fc0d4ffa5d86 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:10.610169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b7c65e4b-4a11-4139-aaf0-fc0d4ffa5d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:10.619187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-76b83620-49db-4480-9c3b-9cd08afc8ad8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:10.620706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-76b83620-49db-4480-9c3b-9cd08afc8ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:10.694307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1026/2047] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:10.695161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c65e4b-4a11-4139-aaf0-fc0d4ffa5d86 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:10.702846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eb7f5-f05b-4e9a-9e60-b304c4796294 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.703149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eb7f5-f05b-4e9a-9e60-b304c4796294 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.703435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eb7f5-f05b-4e9a-9e60-b304c4796294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.725752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3f1eb7f5-f05b-4e9a-9e60-b304c4796294 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:10.726941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3f1eb7f5-f05b-4e9a-9e60-b304c4796294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:10.733903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1027/2048] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:10.738176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eb7f5-f05b-4e9a-9e60-b304c4796294 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:10.752959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eb7f5-f05b-4e9a-9e60-b304c4796294 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:10.758454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b2d4f-575c-4f90-8161-b068b07caf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:10.759302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b2d4f-575c-4f90-8161-b068b07caf4b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.759688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b2d4f-575c-4f90-8161-b068b07caf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.760040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b2d4f-575c-4f90-8161-b068b07caf4b admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.760568 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15d5e1-833d-432c-b855-7893a810bb85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:10.760781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b2d4f-575c-4f90-8161-b068b07caf4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:10.761177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15d5e1-833d-432c-b855-7893a810bb85 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.761400 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b2d4f-575c-4f90-8161-b068b07caf4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:10.761493 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15d5e1-833d-432c-b855-7893a810bb85 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.761738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15d5e1-833d-432c-b855-7893a810bb85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.763470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8f15d5e1-833d-432c-b855-7893a810bb85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:10.786456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b2d4f-575c-4f90-8161-b068b07caf4b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:10.799919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1028/2049] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:13:10.810592 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b2d4f-575c-4f90-8161-b068b07caf4b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:10.821468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b2d4f-575c-4f90-8161-b068b07caf4b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:10.826131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e795b-5a62-4ebf-92f4-e15d9f9836be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:10.826750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e795b-5a62-4ebf-92f4-e15d9f9836be admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.827046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e795b-5a62-4ebf-92f4-e15d9f9836be admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.827335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e795b-5a62-4ebf-92f4-e15d9f9836be admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.827976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e795b-5a62-4ebf-92f4-e15d9f9836be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:10.832885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15d5e1-833d-432c-b855-7893a810bb85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:10.854709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e795b-5a62-4ebf-92f4-e15d9f9836be admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:10.861370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15d5e1-833d-432c-b855-7893a810bb85 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:10.872729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1022/2050] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:10 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:10.889347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1029/2051] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:10 2021] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:10.890574 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15d5e1-833d-432c-b855-7893a810bb85 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:10.902114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15d5e1-833d-432c-b855-7893a810bb85 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:10.986157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb556cf-d2c5-484f-9697-73e02f7477e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:10.987062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb556cf-d2c5-484f-9697-73e02f7477e7 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:10.987352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb556cf-d2c5-484f-9697-73e02f7477e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:10.987645 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb556cf-d2c5-484f-9697-73e02f7477e7 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:10.988268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb556cf-d2c5-484f-9697-73e02f7477e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:11.016871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb556cf-d2c5-484f-9697-73e02f7477e7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:11.045832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1023/2052] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:10 2021] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:11.047029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e795b-5a62-4ebf-92f4-e15d9f9836be admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:11.058096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e795b-5a62-4ebf-92f4-e15d9f9836be admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:11.062362 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e48d79-8d45-47d5-91fe-84fdc2e1756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:11.062990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e48d79-8d45-47d5-91fe-84fdc2e1756a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:11.063279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e48d79-8d45-47d5-91fe-84fdc2e1756a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:11.063717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e48d79-8d45-47d5-91fe-84fdc2e1756a admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:11.064414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e48d79-8d45-47d5-91fe-84fdc2e1756a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:11.090467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e48d79-8d45-47d5-91fe-84fdc2e1756a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:11.102204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1030/2053] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:11 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:11.106637 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb556cf-d2c5-484f-9697-73e02f7477e7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:11.119643 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb556cf-d2c5-484f-9697-73e02f7477e7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:11.123959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5ca6-d5f0-4862-85e5-d1be468be0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:11.124843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5ca6-d5f0-4862-85e5-d1be468be0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:11.125159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5ca6-d5f0-4862-85e5-d1be468be0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:11.125442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5ca6-d5f0-4862-85e5-d1be468be0f2 admin admin] PATH_INFO: `/v3/projects/33b1ea69202f49ab83065befe44ea689/users/0b2cd330d9ba4f6eacd4c63298ac2dbf/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:11.146924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f5ca6-d5f0-4862-85e5-d1be468be0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b1ea69202f49ab83065befe44ea689, user_id=0b2cd330d9ba4f6eacd4c63298ac2dbf, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:11.173550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f5ca6-d5f0-4862-85e5-d1be468be0f2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:11.186453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1024/2054] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:11 2021] PUT /identity/v3/projects/33b1ea69202f49ab83065befe44ea689/users/0b2cd330d9ba4f6eacd4c63298ac2dbf/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:11.197095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f598f1b-9afe-47c1-ad54-8e00fd64bbc3 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:11.197634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f598f1b-9afe-47c1-ad54-8e00fd64bbc3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:11.197634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f598f1b-9afe-47c1-ad54-8e00fd64bbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:11.235699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1f598f1b-9afe-47c1-ad54-8e00fd64bbc3 None None] MFA Rules not processed for user `0b2cd330d9ba4f6eacd4c63298ac2dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:11.236834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1f598f1b-9afe-47c1-ad54-8e00fd64bbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:11.348774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1031/2055] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:11 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:11.353389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5ca6-d5f0-4862-85e5-d1be468be0f2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:11.481380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5ca6-d5f0-4862-85e5-d1be468be0f2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:11.486420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600246-2f2a-4c79-a0a4-4562e022105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:11.487351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600246-2f2a-4c79-a0a4-4562e022105f admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:11.487735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600246-2f2a-4c79-a0a4-4562e022105f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:11.488127 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600246-2f2a-4c79-a0a4-4562e022105f admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:11.489091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7600246-2f2a-4c79-a0a4-4562e022105f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:11.519252 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7600246-2f2a-4c79-a0a4-4562e022105f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:11.558778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1025/2056] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:11 2021] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:11.561416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f598f1b-9afe-47c1-ad54-8e00fd64bbc3 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:11.576248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f598f1b-9afe-47c1-ad54-8e00fd64bbc3 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:11.668175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ea578-8fb1-416e-835d-1a46ac07856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:11.669940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ea578-8fb1-416e-835d-1a46ac07856b admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:11.670355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ea578-8fb1-416e-835d-1a46ac07856b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:11.670776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ea578-8fb1-416e-835d-1a46ac07856b admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:11.672085 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ea578-8fb1-416e-835d-1a46ac07856b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:11.750037 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ea578-8fb1-416e-835d-1a46ac07856b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:11.780704 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1032/2057] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:11 2021] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:11.784224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600246-2f2a-4c79-a0a4-4562e022105f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:11.798373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7600246-2f2a-4c79-a0a4-4562e022105f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:11.815195 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0a67b-a69a-4f57-8ce1-2636cb7a40f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:11.815806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0a67b-a69a-4f57-8ce1-2636cb7a40f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:11.816095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0a67b-a69a-4f57-8ce1-2636cb7a40f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:11.816376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0a67b-a69a-4f57-8ce1-2636cb7a40f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:11.817074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0a67b-a69a-4f57-8ce1-2636cb7a40f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:11.850930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0a67b-a69a-4f57-8ce1-2636cb7a40f2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:11.866179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1026/2058] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:11 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:11.870285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ea578-8fb1-416e-835d-1a46ac07856b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:11.879652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ea578-8fb1-416e-835d-1a46ac07856b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:11.884284 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a1cc-651e-4e73-bb98-4a9092cb5ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:11.885108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a1cc-651e-4e73-bb98-4a9092cb5ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:11.885396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a1cc-651e-4e73-bb98-4a9092cb5ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:11.885678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a1cc-651e-4e73-bb98-4a9092cb5ac7 admin admin] PATH_INFO: `/v3/projects/9f3d93637f50490b8643b00420d81f55/users/5c69565ee9d745b6813da44cb08d4b5d/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:11.906418 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133a1cc-651e-4e73-bb98-4a9092cb5ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3d93637f50490b8643b00420d81f55, user_id=5c69565ee9d745b6813da44cb08d4b5d, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:11.934744 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133a1cc-651e-4e73-bb98-4a9092cb5ac7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:11.950501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1033/2059] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:11 2021] PUT /identity/v3/projects/9f3d93637f50490b8643b00420d81f55/users/5c69565ee9d745b6813da44cb08d4b5d/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:11.954309 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0a67b-a69a-4f57-8ce1-2636cb7a40f2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:11.964488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0a67b-a69a-4f57-8ce1-2636cb7a40f2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:12.077297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163f4d0-52f9-42ae-9844-2b13011ed512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:12.078097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163f4d0-52f9-42ae-9844-2b13011ed512 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:12.078494 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163f4d0-52f9-42ae-9844-2b13011ed512 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:12.078941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163f4d0-52f9-42ae-9844-2b13011ed512 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:12.079992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163f4d0-52f9-42ae-9844-2b13011ed512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:12.125970 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163f4d0-52f9-42ae-9844-2b13011ed512 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:12.154651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1027/2060] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:11 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:12.156023 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a1cc-651e-4e73-bb98-4a9092cb5ac7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:12.169416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a1cc-651e-4e73-bb98-4a9092cb5ac7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:12.175462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4cce-fe16-4cd9-9ad6-f5b2c34cac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:12.176299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4cce-fe16-4cd9-9ad6-f5b2c34cac43 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:12.176637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4cce-fe16-4cd9-9ad6-f5b2c34cac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:12.178037 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c4cce-fe16-4cd9-9ad6-f5b2c34cac43 admin admin] PATH_INFO: `/v3/projects/9f3d93637f50490b8643b00420d81f55/users/5c69565ee9d745b6813da44cb08d4b5d/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:12.180270 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c4cce-fe16-4cd9-9ad6-f5b2c34cac43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3d93637f50490b8643b00420d81f55, user_id=5c69565ee9d745b6813da44cb08d4b5d, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:12.210344 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c4cce-fe16-4cd9-9ad6-f5b2c34cac43 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:12.222984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1034/2061] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:12 2021] PUT /identity/v3/projects/9f3d93637f50490b8643b00420d81f55/users/5c69565ee9d745b6813da44cb08d4b5d/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:12.226832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163f4d0-52f9-42ae-9844-2b13011ed512 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:12.236435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163f4d0-52f9-42ae-9844-2b13011ed512 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:12.306679 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd04e6-0ad4-436d-81b7-62fcdb479853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:12.307299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd04e6-0ad4-436d-81b7-62fcdb479853 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:12.307591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd04e6-0ad4-436d-81b7-62fcdb479853 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:12.307876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd04e6-0ad4-436d-81b7-62fcdb479853 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:12.308579 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd04e6-0ad4-436d-81b7-62fcdb479853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:12.336187 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd04e6-0ad4-436d-81b7-62fcdb479853 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:12.347175 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1028/2062] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:12 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:12.351425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4cce-fe16-4cd9-9ad6-f5b2c34cac43 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:12.367603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c4cce-fe16-4cd9-9ad6-f5b2c34cac43 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:12.375026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66986d-bdcd-4267-a5ab-4a0cb7ce3abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:12.375871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66986d-bdcd-4267-a5ab-4a0cb7ce3abd admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:12.376165 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66986d-bdcd-4267-a5ab-4a0cb7ce3abd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:12.376456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66986d-bdcd-4267-a5ab-4a0cb7ce3abd admin admin] PATH_INFO: `/v3/projects/9f3d93637f50490b8643b00420d81f55/users/5c69565ee9d745b6813da44cb08d4b5d/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:12.378234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66986d-bdcd-4267-a5ab-4a0cb7ce3abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3d93637f50490b8643b00420d81f55, user_id=5c69565ee9d745b6813da44cb08d4b5d, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:12.445221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66986d-bdcd-4267-a5ab-4a0cb7ce3abd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:12.470728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1035/2063] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:12 2021] PUT /identity/v3/projects/9f3d93637f50490b8643b00420d81f55/users/5c69565ee9d745b6813da44cb08d4b5d/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:12.480802 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb06e9-8154-4b85-b35f-1a49dafe76ca None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:12.481249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb06e9-8154-4b85-b35f-1a49dafe76ca None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:12.482054 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb06e9-8154-4b85-b35f-1a49dafe76ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:12.528690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-96bb06e9-8154-4b85-b35f-1a49dafe76ca None None] MFA Rules not processed for user `5c69565ee9d745b6813da44cb08d4b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:12.532455 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-96bb06e9-8154-4b85-b35f-1a49dafe76ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:12.650440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5911a14-ea97-49c0-8637-68447f89a2d0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:12.650728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5911a14-ea97-49c0-8637-68447f89a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:12.651042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5911a14-ea97-49c0-8637-68447f89a2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:12.675415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c5911a14-ea97-49c0-8637-68447f89a2d0 None None] MFA Rules not processed for user `d33fa612914a45dca090798991b8dfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:12.676467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c5911a14-ea97-49c0-8637-68447f89a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:12.695437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1029/2064] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:12 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:12.754093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb06e9-8154-4b85-b35f-1a49dafe76ca None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:12.756128 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-96bb06e9-8154-4b85-b35f-1a49dafe76ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:12.763323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1036/2065] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:12 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:12.822565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb06e9-8154-4b85-b35f-1a49dafe76ca None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:12.825922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c36de6-7928-4ad3-b109-84f4af4760dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:12.826508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c36de6-7928-4ad3-b109-84f4af4760dc service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:12.826829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c36de6-7928-4ad3-b109-84f4af4760dc service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:12.827111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c36de6-7928-4ad3-b109-84f4af4760dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:12.837783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c36de6-7928-4ad3-b109-84f4af4760dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:12.863781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c36de6-7928-4ad3-b109-84f4af4760dc service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:12.873772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1030/2066] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:12 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:13.306126 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5911a14-ea97-49c0-8637-68447f89a2d0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:13.316080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5911a14-ea97-49c0-8637-68447f89a2d0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:13.319620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728452b6-23b5-430c-975d-adacff0ca518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:13.320213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728452b6-23b5-430c-975d-adacff0ca518 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:13.320502 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728452b6-23b5-430c-975d-adacff0ca518 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:13.320784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728452b6-23b5-430c-975d-adacff0ca518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:13.322510 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-728452b6-23b5-430c-975d-adacff0ca518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:13.399543 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728452b6-23b5-430c-975d-adacff0ca518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:13.426574 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728452b6-23b5-430c-975d-adacff0ca518 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:13.438642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1037/2067] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:13 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:13.957336 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c36de6-7928-4ad3-b109-84f4af4760dc service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:13.972761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c36de6-7928-4ad3-b109-84f4af4760dc service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:13.985031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ed33-b5da-4fc5-bd24-fb15eac64e6d tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c69565ee9d745b6813da44cb08d4b5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f3d93637f50490b8643b00420d81f55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:13.986045 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ed33-b5da-4fc5-bd24-fb15eac64e6d tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:13.986824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ed33-b5da-4fc5-bd24-fb15eac64e6d tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:13.987334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ed33-b5da-4fc5-bd24-fb15eac64e6d tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:13.988436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ed33-b5da-4fc5-bd24-fb15eac64e6d tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:13.988984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ed33-b5da-4fc5-bd24-fb15eac64e6d tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:14.027491 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ed33-b5da-4fc5-bd24-fb15eac64e6d tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:14.048558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1031/2068] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:14.049809 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728452b6-23b5-430c-975d-adacff0ca518 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:14.065107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728452b6-23b5-430c-975d-adacff0ca518 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:14.070779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f680e-1aa1-494b-8a7a-801bad7bb2f2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c69565ee9d745b6813da44cb08d4b5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f3d93637f50490b8643b00420d81f55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:14.071634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f680e-1aa1-494b-8a7a-801bad7bb2f2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:14.072083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f680e-1aa1-494b-8a7a-801bad7bb2f2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:14.072521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f680e-1aa1-494b-8a7a-801bad7bb2f2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:14.074182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f680e-1aa1-494b-8a7a-801bad7bb2f2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:14.113766 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f680e-1aa1-494b-8a7a-801bad7bb2f2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:14.151761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1038/2069] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:14 2021] POST /identity/v3/projects => generated 352 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:14.158183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ed33-b5da-4fc5-bd24-fb15eac64e6d tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:14.171174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ed33-b5da-4fc5-bd24-fb15eac64e6d tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:14.270375 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c69565ee9d745b6813da44cb08d4b5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f3d93637f50490b8643b00420d81f55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:14.301608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:14.302105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:14.302322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:14.303574 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:14.303937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:14.330917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:14.345689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1032/2070] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:14.410406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f680e-1aa1-494b-8a7a-801bad7bb2f2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:14.422061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f680e-1aa1-494b-8a7a-801bad7bb2f2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:14.428794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c69565ee9d745b6813da44cb08d4b5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f3d93637f50490b8643b00420d81f55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:14.429817 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:14.430268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:14.430762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] PATH_INFO: `/v3/projects/4724f73df7b54d9189dd336058b805f5` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:14.432180 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4724f73df7b54d9189dd336058b805f5)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:14.472280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:14.536070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4724f73df7b54d9189dd336058b805f5', 'request_id': 'req-cdac44b1-f856-4905-8757-b40c9a0098f1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:14.549916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4724f73df7b54d9189dd336058b805f5', 'request_id': 'req-cdac44b1-f856-4905-8757-b40c9a0098f1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:14.559273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4724f73df7b54d9189dd336058b805f5', 'request_id': 'req-cdac44b1-f856-4905-8757-b40c9a0098f1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:14.571347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] The token cache is being invalidate because project 4724f73df7b54d9189dd336058b805f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:14.571690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:14.572316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:14.577246 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1039/2071] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:14 2021] DELETE /identity/v3/projects/4724f73df7b54d9189dd336058b805f5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:14.614388 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:14.616530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:14.696196 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d05ec-be83-4d8d-977e-177d08b72af2 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:14.759017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf46198-4793-432e-88f8-d160e0e292a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:14.759624 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf46198-4793-432e-88f8-d160e0e292a8 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:14.759913 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf46198-4793-432e-88f8-d160e0e292a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:14.760195 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf46198-4793-432e-88f8-d160e0e292a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:14.761984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cdf46198-4793-432e-88f8-d160e0e292a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:14.838851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:14.840310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:14.852569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf46198-4793-432e-88f8-d160e0e292a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:14.879967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf46198-4793-432e-88f8-d160e0e292a8 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:14.890854 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1033/2072] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:14 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:14.924118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac44b1-f856-4905-8757-b40c9a0098f1 tempest-VolumeQuotaClassesTest-1142670694 tempest-VolumeQuotaClassesTest-1142670694-project-admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:14.928447 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:14.929255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:14.929545 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:14.929850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] PATH_INFO: `/v3/users/0b2cd330d9ba4f6eacd4c63298ac2dbf` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:14.931025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2cd330d9ba4f6eacd4c63298ac2dbf)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:14.956893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:15.026557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2cd330d9ba4f6eacd4c63298ac2dbf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.053526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2cd330d9ba4f6eacd4c63298ac2dbf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.054871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2cd330d9ba4f6eacd4c63298ac2dbf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.065892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2cd330d9ba4f6eacd4c63298ac2dbf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.075339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2cd330d9ba4f6eacd4c63298ac2dbf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.090741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1040/2073] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:14 2021] DELETE /identity/v3/users/0b2cd330d9ba4f6eacd4c63298ac2dbf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:15.090846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b7be-dfcf-4bd1-b8bc-449194ca1ecd None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:15.090846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b7be-dfcf-4bd1-b8bc-449194ca1ecd None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:15.090846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b7be-dfcf-4bd1-b8bc-449194ca1ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:15.110530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-afb8b7be-dfcf-4bd1-b8bc-449194ca1ecd None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:15.111938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-afb8b7be-dfcf-4bd1-b8bc-449194ca1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:15.185343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1034/2074] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:15.197879 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:15.199856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:15.270072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651e84-d8db-4235-a444-46b541181429 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:15.274251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ff162-36d2-4dee-8793-b66dfa725bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:15.274867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ff162-36d2-4dee-8793-b66dfa725bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:15.275160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ff162-36d2-4dee-8793-b66dfa725bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:15.275450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ff162-36d2-4dee-8793-b66dfa725bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:15.284949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ff162-36d2-4dee-8793-b66dfa725bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:15.311606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ff162-36d2-4dee-8793-b66dfa725bc7 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:15.322185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1041/2075] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:15.719213 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b7be-dfcf-4bd1-b8bc-449194ca1ecd None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:15.720658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-afb8b7be-dfcf-4bd1-b8bc-449194ca1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:15.732750 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b7be-dfcf-4bd1-b8bc-449194ca1ecd None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:15.738204 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:15.739660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:15.741776 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:15.742149 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] PATH_INFO: `/v3/projects/33b1ea69202f49ab83065befe44ea689` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:15.743703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b1ea69202f49ab83065befe44ea689)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:15.787971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:15.872163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b1ea69202f49ab83065befe44ea689', 'request_id': 'req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.884144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b1ea69202f49ab83065befe44ea689', 'request_id': 'req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.892274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b1ea69202f49ab83065befe44ea689', 'request_id': 'req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.904744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] The token cache is being invalidate because project 33b1ea69202f49ab83065befe44ea689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:15.905040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.905681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:15.907121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1035/2076] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:15 2021] DELETE /identity/v3/projects/33b1ea69202f49ab83065befe44ea689 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:15.911026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ff162-36d2-4dee-8793-b66dfa725bc7 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:15.921577 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ff162-36d2-4dee-8793-b66dfa725bc7 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:15.992298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:15.993094 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:15.993379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:15.993660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] PATH_INFO: `/v3/users/5c69565ee9d745b6813da44cb08d4b5d` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:15.994882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c69565ee9d745b6813da44cb08d4b5d)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:16.020672 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:16.074176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c69565ee9d745b6813da44cb08d4b5d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.086937 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c69565ee9d745b6813da44cb08d4b5d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.087651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c69565ee9d745b6813da44cb08d4b5d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.095376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c69565ee9d745b6813da44cb08d4b5d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.102968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4e5bd275-a1f3-4563-bb06-b6d042ec1fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c69565ee9d745b6813da44cb08d4b5d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.109279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1042/2077] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:15 2021] DELETE /identity/v3/users/5c69565ee9d745b6813da44cb08d4b5d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:16.515952 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:16.517893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:16.531619 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4dff1-6bb7-44d1-9c57-69706074f0c9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:16.602914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:16.603712 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:16.604003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:16.604287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] PATH_INFO: `/v3/projects/9f3d93637f50490b8643b00420d81f55` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:16.605463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3d93637f50490b8643b00420d81f55)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:16.632337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:16.681603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3d93637f50490b8643b00420d81f55', 'request_id': 'req-8e06240e-062f-48a2-b3f6-1665ef46fb3a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.692910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3d93637f50490b8643b00420d81f55', 'request_id': 'req-8e06240e-062f-48a2-b3f6-1665ef46fb3a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.700509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3d93637f50490b8643b00420d81f55', 'request_id': 'req-8e06240e-062f-48a2-b3f6-1665ef46fb3a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.711063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] The token cache is being invalidate because project 9f3d93637f50490b8643b00420d81f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:16.711357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.711984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8e06240e-062f-48a2-b3f6-1665ef46fb3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:16.713746 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1036/2078] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:16 2021] DELETE /identity/v3/projects/9f3d93637f50490b8643b00420d81f55 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:16.719379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a998-5310-4259-9941-83efd17c6ac4 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:16.719706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a998-5310-4259-9941-83efd17c6ac4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:16.719995 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a998-5310-4259-9941-83efd17c6ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:16.743184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-9939a998-5310-4259-9941-83efd17c6ac4 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:16.744329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9939a998-5310-4259-9941-83efd17c6ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:16.808527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1043/2079] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:16.817018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229ff8b-6e02-4a5e-87b8-3c27c62f9d5b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:16.817318 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229ff8b-6e02-4a5e-87b8-3c27c62f9d5b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:16.817837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229ff8b-6e02-4a5e-87b8-3c27c62f9d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:16.841299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7229ff8b-6e02-4a5e-87b8-3c27c62f9d5b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:16.842449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7229ff8b-6e02-4a5e-87b8-3c27c62f9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:16.850163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1037/2080] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:16.854408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a998-5310-4259-9941-83efd17c6ac4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:16.864244 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a998-5310-4259-9941-83efd17c6ac4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:16.868849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97235a1-f63c-4cd4-8c46-4d533a76387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:16.869566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97235a1-f63c-4cd4-8c46-4d533a76387c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:16.869729 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97235a1-f63c-4cd4-8c46-4d533a76387c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:16.870017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97235a1-f63c-4cd4-8c46-4d533a76387c admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:16.870740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97235a1-f63c-4cd4-8c46-4d533a76387c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:16.871043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97235a1-f63c-4cd4-8c46-4d533a76387c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:16.897887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97235a1-f63c-4cd4-8c46-4d533a76387c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:16.911405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1044/2081] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:13:16.916641 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229ff8b-6e02-4a5e-87b8-3c27c62f9d5b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:16.925617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229ff8b-6e02-4a5e-87b8-3c27c62f9d5b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:16.930597 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0bae-6205-46ef-8085-5523bb6d63bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:16.931358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0bae-6205-46ef-8085-5523bb6d63bf admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:16.931635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0bae-6205-46ef-8085-5523bb6d63bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:16.931918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0bae-6205-46ef-8085-5523bb6d63bf admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:16.932555 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf0bae-6205-46ef-8085-5523bb6d63bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:16.959609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf0bae-6205-46ef-8085-5523bb6d63bf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:16.990102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1038/2082] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:16 2021] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:16.994274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97235a1-f63c-4cd4-8c46-4d533a76387c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:17.003890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97235a1-f63c-4cd4-8c46-4d533a76387c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:17.074522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a80b-facb-4f46-8e47-5b344526eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:17.075173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a80b-facb-4f46-8e47-5b344526eccd admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:17.075470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a80b-facb-4f46-8e47-5b344526eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:17.075758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a80b-facb-4f46-8e47-5b344526eccd admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:17.076397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92a80b-facb-4f46-8e47-5b344526eccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:17.105010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92a80b-facb-4f46-8e47-5b344526eccd admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:17.127042 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1045/2083] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:16 2021] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:17.131485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0bae-6205-46ef-8085-5523bb6d63bf admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:17.141626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0bae-6205-46ef-8085-5523bb6d63bf admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:17.146974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d971a-3d19-4957-8f27-3eb9f76f5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:17.147573 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d971a-3d19-4957-8f27-3eb9f76f5c1c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:17.147864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d971a-3d19-4957-8f27-3eb9f76f5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:17.148205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d971a-3d19-4957-8f27-3eb9f76f5c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:17.148857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d971a-3d19-4957-8f27-3eb9f76f5c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:17.174373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d971a-3d19-4957-8f27-3eb9f76f5c1c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:17.185532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1039/2084] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:17 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:17.198163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a80b-facb-4f46-8e47-5b344526eccd admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:17.209402 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a80b-facb-4f46-8e47-5b344526eccd admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:17.214163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe806d-f146-4433-a00f-d3a8e2fa7c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:17.215019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe806d-f146-4433-a00f-d3a8e2fa7c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:17.215310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe806d-f146-4433-a00f-d3a8e2fa7c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:17.215593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe806d-f146-4433-a00f-d3a8e2fa7c3d admin admin] PATH_INFO: `/v3/projects/3183f3c1bafd463a94bc9f3883744e10/users/0556a5878bcd4640ba43107ba05a6ddf/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:17.243570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe806d-f146-4433-a00f-d3a8e2fa7c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3183f3c1bafd463a94bc9f3883744e10, user_id=0556a5878bcd4640ba43107ba05a6ddf, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:17.271313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe806d-f146-4433-a00f-d3a8e2fa7c3d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:17.292075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1046/2085] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:17 2021] PUT /identity/v3/projects/3183f3c1bafd463a94bc9f3883744e10/users/0556a5878bcd4640ba43107ba05a6ddf/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:17.297484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410b99-6251-4c8f-b19e-36d2e0e2ec4e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:17.297789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410b99-6251-4c8f-b19e-36d2e0e2ec4e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:17.298084 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410b99-6251-4c8f-b19e-36d2e0e2ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:17.334671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-03410b99-6251-4c8f-b19e-36d2e0e2ec4e None None] MFA Rules not processed for user `0556a5878bcd4640ba43107ba05a6ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:17.335825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-03410b99-6251-4c8f-b19e-36d2e0e2ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:17.408186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1040/2086] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:17 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:17.413163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe806d-f146-4433-a00f-d3a8e2fa7c3d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:17.484170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe806d-f146-4433-a00f-d3a8e2fa7c3d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:17.489290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a75005-97f0-4e57-930b-7ecbbfd95a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:17.490746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a75005-97f0-4e57-930b-7ecbbfd95a66 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:17.491043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a75005-97f0-4e57-930b-7ecbbfd95a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:17.491330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a75005-97f0-4e57-930b-7ecbbfd95a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:17.491989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a75005-97f0-4e57-930b-7ecbbfd95a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:17.519585 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a75005-97f0-4e57-930b-7ecbbfd95a66 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:17.554669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1047/2087] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:17 2021] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:17.558006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03410b99-6251-4c8f-b19e-36d2e0e2ec4e None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:17.569736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03410b99-6251-4c8f-b19e-36d2e0e2ec4e None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:17.651813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94df0-c0cd-45e8-8ec2-74e848655805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:17.652893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94df0-c0cd-45e8-8ec2-74e848655805 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:17.653191 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94df0-c0cd-45e8-8ec2-74e848655805 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:17.653475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94df0-c0cd-45e8-8ec2-74e848655805 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:17.654133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c94df0-c0cd-45e8-8ec2-74e848655805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:17.681625 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c94df0-c0cd-45e8-8ec2-74e848655805 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:17.704487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1041/2088] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:17 2021] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:17.705725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a75005-97f0-4e57-930b-7ecbbfd95a66 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:17.716835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a75005-97f0-4e57-930b-7ecbbfd95a66 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:17.721081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98760b-40e1-427f-aeb2-72963d7ff8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:17.721702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98760b-40e1-427f-aeb2-72963d7ff8dc admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:17.721989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98760b-40e1-427f-aeb2-72963d7ff8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:17.722319 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98760b-40e1-427f-aeb2-72963d7ff8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:17.723014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98760b-40e1-427f-aeb2-72963d7ff8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:17.750328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98760b-40e1-427f-aeb2-72963d7ff8dc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:17.847136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1048/2089] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:17 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:17.851897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94df0-c0cd-45e8-8ec2-74e848655805 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:17.861371 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94df0-c0cd-45e8-8ec2-74e848655805 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:17.865755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa05f33-d33c-4568-82e5-e116153f98cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:17.866561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa05f33-d33c-4568-82e5-e116153f98cf admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:17.866878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa05f33-d33c-4568-82e5-e116153f98cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:17.867164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa05f33-d33c-4568-82e5-e116153f98cf admin admin] PATH_INFO: `/v3/projects/a55dd3eb90f74d90a6ed2d1042f2cc09/users/060f415920fb477185589723d3601a8e/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:17.887486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa05f33-d33c-4568-82e5-e116153f98cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55dd3eb90f74d90a6ed2d1042f2cc09, user_id=060f415920fb477185589723d3601a8e, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:17.915081 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa05f33-d33c-4568-82e5-e116153f98cf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:17.928701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1042/2090] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:17 2021] PUT /identity/v3/projects/a55dd3eb90f74d90a6ed2d1042f2cc09/users/060f415920fb477185589723d3601a8e/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:17.932624 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98760b-40e1-427f-aeb2-72963d7ff8dc admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:17.942363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98760b-40e1-427f-aeb2-72963d7ff8dc admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:18.008446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d0ff2-38b8-44f3-a38e-5cc36805556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:18.009041 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d0ff2-38b8-44f3-a38e-5cc36805556c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:18.009333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d0ff2-38b8-44f3-a38e-5cc36805556c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:18.009651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d0ff2-38b8-44f3-a38e-5cc36805556c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:18.010350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d0ff2-38b8-44f3-a38e-5cc36805556c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:18.037389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d0ff2-38b8-44f3-a38e-5cc36805556c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:18.049392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1049/2091] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:17 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:18.053795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa05f33-d33c-4568-82e5-e116153f98cf admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:18.064490 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa05f33-d33c-4568-82e5-e116153f98cf admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:18.070176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6de473-8f1f-48b8-a6d8-a1f99e3710f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:18.071068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de473-8f1f-48b8-a6d8-a1f99e3710f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:18.071454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de473-8f1f-48b8-a6d8-a1f99e3710f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:18.071773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de473-8f1f-48b8-a6d8-a1f99e3710f6 admin admin] PATH_INFO: `/v3/projects/a55dd3eb90f74d90a6ed2d1042f2cc09/users/060f415920fb477185589723d3601a8e/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:18.073690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6de473-8f1f-48b8-a6d8-a1f99e3710f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55dd3eb90f74d90a6ed2d1042f2cc09, user_id=060f415920fb477185589723d3601a8e, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:18.101131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6de473-8f1f-48b8-a6d8-a1f99e3710f6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:18.112040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1043/2092] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:18 2021] PUT /identity/v3/projects/a55dd3eb90f74d90a6ed2d1042f2cc09/users/060f415920fb477185589723d3601a8e/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:18.116016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d0ff2-38b8-44f3-a38e-5cc36805556c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:18.125295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d0ff2-38b8-44f3-a38e-5cc36805556c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:18.210279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ed3d6-73bc-4e0c-aaa5-94a22ae2b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:18.210965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ed3d6-73bc-4e0c-aaa5-94a22ae2b7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:18.211259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ed3d6-73bc-4e0c-aaa5-94a22ae2b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:18.211548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ed3d6-73bc-4e0c-aaa5-94a22ae2b7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:18.212617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ed3d6-73bc-4e0c-aaa5-94a22ae2b7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:18.243191 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ed3d6-73bc-4e0c-aaa5-94a22ae2b7e9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:18.256335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1050/2093] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:18 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:18.260556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6de473-8f1f-48b8-a6d8-a1f99e3710f6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:18.275430 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6de473-8f1f-48b8-a6d8-a1f99e3710f6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:18.280315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14003a2-fbb3-40d7-b2e6-8e1454272b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:18.281420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14003a2-fbb3-40d7-b2e6-8e1454272b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:18.281776 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14003a2-fbb3-40d7-b2e6-8e1454272b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:18.282115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14003a2-fbb3-40d7-b2e6-8e1454272b4b admin admin] PATH_INFO: `/v3/projects/a55dd3eb90f74d90a6ed2d1042f2cc09/users/060f415920fb477185589723d3601a8e/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:18.284581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14003a2-fbb3-40d7-b2e6-8e1454272b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55dd3eb90f74d90a6ed2d1042f2cc09, user_id=060f415920fb477185589723d3601a8e, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:18.316938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14003a2-fbb3-40d7-b2e6-8e1454272b4b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:18.366731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1044/2094] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:18 2021] PUT /identity/v3/projects/a55dd3eb90f74d90a6ed2d1042f2cc09/users/060f415920fb477185589723d3601a8e/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:18.379389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868412f-758f-469f-9309-d477a542fca4 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:18.380650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868412f-758f-469f-9309-d477a542fca4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:18.381147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868412f-758f-469f-9309-d477a542fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:18.494138 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-d868412f-758f-469f-9309-d477a542fca4 None None] MFA Rules not processed for user `060f415920fb477185589723d3601a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:18.496519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d868412f-758f-469f-9309-d477a542fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:18.720144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1051/2095] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:18 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:18.831783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14003a2-fbb3-40d7-b2e6-8e1454272b4b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:18.834552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a14003a2-fbb3-40d7-b2e6-8e1454272b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:19.070948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14003a2-fbb3-40d7-b2e6-8e1454272b4b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:19.076523 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c6a70-82ae-414f-8863-6362cb0bdda1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:19.083711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c6a70-82ae-414f-8863-6362cb0bdda1 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:19.084215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c6a70-82ae-414f-8863-6362cb0bdda1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:19.086853 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c6a70-82ae-414f-8863-6362cb0bdda1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:19.105219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c6a70-82ae-414f-8863-6362cb0bdda1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:19.148286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c6a70-82ae-414f-8863-6362cb0bdda1 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:19.151735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1045/2096] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:18 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:19.251803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868412f-758f-469f-9309-d477a542fca4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:19.261555 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868412f-758f-469f-9309-d477a542fca4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:19.264937 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7181-bdaf-415f-9e36-39868d8512ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:19.265538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7181-bdaf-415f-9e36-39868d8512ee service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:19.265855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7181-bdaf-415f-9e36-39868d8512ee service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:19.266108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7181-bdaf-415f-9e36-39868d8512ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:19.345263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f7181-bdaf-415f-9e36-39868d8512ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:19.372966 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f7181-bdaf-415f-9e36-39868d8512ee service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:19.385083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1052/2097] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:19 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:20.747585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c6a70-82ae-414f-8863-6362cb0bdda1 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:20.748959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-192c6a70-82ae-414f-8863-6362cb0bdda1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:20.838153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c6a70-82ae-414f-8863-6362cb0bdda1 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:20.842813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:20.843789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:20.844086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:20.844546 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] PATH_INFO: `/v3/users/231001befca04f798ca7e580825b19b2` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:20.845942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231001befca04f798ca7e580825b19b2)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:20.883552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:20.944959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231001befca04f798ca7e580825b19b2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:20.959046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231001befca04f798ca7e580825b19b2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:20.960115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231001befca04f798ca7e580825b19b2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:20.968935 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231001befca04f798ca7e580825b19b2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:20.979774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-123ea4be-0e1f-4464-8507-ed1bfc742ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231001befca04f798ca7e580825b19b2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:20.992586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1046/2098] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:20 2021] DELETE /identity/v3/users/231001befca04f798ca7e580825b19b2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:21.254224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7181-bdaf-415f-9e36-39868d8512ee service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:21.266977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7181-bdaf-415f-9e36-39868d8512ee service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:21.370610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:21.371500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:21.371791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:21.372234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] PATH_INFO: `/v3/projects/b3b35552e84f4a30bab9b2f278d5dfdb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:21.373408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b35552e84f4a30bab9b2f278d5dfdb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:21.402766 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:21.459767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b35552e84f4a30bab9b2f278d5dfdb', 'request_id': 'req-5a2340ee-228d-4600-ae86-e1e03350ad1f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:21.474711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b35552e84f4a30bab9b2f278d5dfdb', 'request_id': 'req-5a2340ee-228d-4600-ae86-e1e03350ad1f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:21.484156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b35552e84f4a30bab9b2f278d5dfdb', 'request_id': 'req-5a2340ee-228d-4600-ae86-e1e03350ad1f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:21.498185 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] The token cache is being invalidate because project b3b35552e84f4a30bab9b2f278d5dfdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:21.498392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:21.499249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5a2340ee-228d-4600-ae86-e1e03350ad1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:21.501586 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1053/2099] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:21 2021] DELETE /identity/v3/projects/b3b35552e84f4a30bab9b2f278d5dfdb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:21.508021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a388c69-78b8-4a45-b0af-d92a42646dc3 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:21.508436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a388c69-78b8-4a45-b0af-d92a42646dc3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:21.508751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a388c69-78b8-4a45-b0af-d92a42646dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:21.538283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-2a388c69-78b8-4a45-b0af-d92a42646dc3 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:21.539869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2a388c69-78b8-4a45-b0af-d92a42646dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:21.638894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1047/2100] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:21.641653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8d89b-5158-4d6a-a16b-f4d370e8bedc None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:21.641964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8d89b-5158-4d6a-a16b-f4d370e8bedc None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:21.642322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8d89b-5158-4d6a-a16b-f4d370e8bedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:21.667414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-b0f8d89b-5158-4d6a-a16b-f4d370e8bedc None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:21.668580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b0f8d89b-5158-4d6a-a16b-f4d370e8bedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:21.675877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1054/2101] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:21.680997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a388c69-78b8-4a45-b0af-d92a42646dc3 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:21.690582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a388c69-78b8-4a45-b0af-d92a42646dc3 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:21.695828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cffff-f184-4a69-8099-a1c98bb1e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:21.696430 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cffff-f184-4a69-8099-a1c98bb1e726 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:21.696722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cffff-f184-4a69-8099-a1c98bb1e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:21.697011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cffff-f184-4a69-8099-a1c98bb1e726 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:21.697712 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cffff-f184-4a69-8099-a1c98bb1e726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:21.698015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cffff-f184-4a69-8099-a1c98bb1e726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:21.724811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cffff-f184-4a69-8099-a1c98bb1e726 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:21.743126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1048/2102] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:21.744308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8d89b-5158-4d6a-a16b-f4d370e8bedc None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:21.754231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8d89b-5158-4d6a-a16b-f4d370e8bedc None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:21.759860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb855bf9-478b-424e-b753-98f003a14035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:21.760319 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb855bf9-478b-424e-b753-98f003a14035 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:21.760613 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb855bf9-478b-424e-b753-98f003a14035 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:21.760898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb855bf9-478b-424e-b753-98f003a14035 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:21.761741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb855bf9-478b-424e-b753-98f003a14035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:21.789919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb855bf9-478b-424e-b753-98f003a14035 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:21.844879 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1055/2103] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:21 2021] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:21.849087 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cffff-f184-4a69-8099-a1c98bb1e726 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:21.867851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cffff-f184-4a69-8099-a1c98bb1e726 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:21.947444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f77ad-3e3f-4949-a199-1348fa43f862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:21.948212 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f77ad-3e3f-4949-a199-1348fa43f862 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:21.948500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f77ad-3e3f-4949-a199-1348fa43f862 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:21.948779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f77ad-3e3f-4949-a199-1348fa43f862 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:21.949411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f77ad-3e3f-4949-a199-1348fa43f862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:21.976956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f77ad-3e3f-4949-a199-1348fa43f862 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:21.999197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1049/2104] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:21 2021] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:22.003211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb855bf9-478b-424e-b753-98f003a14035 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:22.014473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb855bf9-478b-424e-b753-98f003a14035 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:22.020570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a92632-0c6e-484d-a797-020c01b16392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:22.021739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a92632-0c6e-484d-a797-020c01b16392 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:22.022240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a92632-0c6e-484d-a797-020c01b16392 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:22.022784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a92632-0c6e-484d-a797-020c01b16392 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:22.023742 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a92632-0c6e-484d-a797-020c01b16392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:22.052932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a92632-0c6e-484d-a797-020c01b16392 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:22.066128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1056/2105] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:22 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:22.071263 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f77ad-3e3f-4949-a199-1348fa43f862 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:22.081486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f77ad-3e3f-4949-a199-1348fa43f862 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:22.088272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b8e0-ebb4-49da-add7-b7d2125be570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:22.089110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b8e0-ebb4-49da-add7-b7d2125be570 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:22.089410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b8e0-ebb4-49da-add7-b7d2125be570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:22.089751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b8e0-ebb4-49da-add7-b7d2125be570 admin admin] PATH_INFO: `/v3/projects/1027d0d8d53b4a18a52af1935304a4a4/users/9c7d443e8f994d25b9827efb1b4919bd/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:22.111015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b8e0-ebb4-49da-add7-b7d2125be570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1027d0d8d53b4a18a52af1935304a4a4, user_id=9c7d443e8f994d25b9827efb1b4919bd, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:22.138849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b8e0-ebb4-49da-add7-b7d2125be570 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:22.156206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1050/2106] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:22 2021] PUT /identity/v3/projects/1027d0d8d53b4a18a52af1935304a4a4/users/9c7d443e8f994d25b9827efb1b4919bd/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:22.157911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b9ff-23b9-4027-b30b-98664bba5702 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:22.158212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b9ff-23b9-4027-b30b-98664bba5702 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:22.158503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209b9ff-23b9-4027-b30b-98664bba5702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:22.183283 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-4209b9ff-23b9-4027-b30b-98664bba5702 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:22.184497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4209b9ff-23b9-4027-b30b-98664bba5702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:22.261251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1057/2107] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:22.273036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b8e0-ebb4-49da-add7-b7d2125be570 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:22.275139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a945b8e0-ebb4-49da-add7-b7d2125be570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:22.346918 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b8e0-ebb4-49da-add7-b7d2125be570 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:22.351159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f06605-2336-4430-83ba-7e34fb117982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:22.351748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f06605-2336-4430-83ba-7e34fb117982 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:22.352041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f06605-2336-4430-83ba-7e34fb117982 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:22.352328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f06605-2336-4430-83ba-7e34fb117982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:22.363271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f06605-2336-4430-83ba-7e34fb117982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:22.391901 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f06605-2336-4430-83ba-7e34fb117982 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:22.403021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1051/2108] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:24.917377 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209b9ff-23b9-4027-b30b-98664bba5702 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:24.918770 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4209b9ff-23b9-4027-b30b-98664bba5702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:24.951075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209b9ff-23b9-4027-b30b-98664bba5702 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:24.969601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:24.970873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:24.971370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:24.971896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] PATH_INFO: `/v3/users/0556a5878bcd4640ba43107ba05a6ddf` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:24.975121 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0556a5878bcd4640ba43107ba05a6ddf)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:25.051456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:25.131471 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0556a5878bcd4640ba43107ba05a6ddf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.148120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0556a5878bcd4640ba43107ba05a6ddf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.148878 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0556a5878bcd4640ba43107ba05a6ddf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.159512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0556a5878bcd4640ba43107ba05a6ddf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.168846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0556a5878bcd4640ba43107ba05a6ddf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.184959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef26f5-4605-43d9-a2b9-fac40765d73d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:25.185492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1058/2109] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:24 2021] DELETE /identity/v3/users/0556a5878bcd4640ba43107ba05a6ddf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:25.185586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef26f5-4605-43d9-a2b9-fac40765d73d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:25.185793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef26f5-4605-43d9-a2b9-fac40765d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:25.222224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-68ef26f5-4605-43d9-a2b9-fac40765d73d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:25.223421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-68ef26f5-4605-43d9-a2b9-fac40765d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:25.306765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1052/2110] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:25.317216 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:25.318831 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:25.393690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19134e9-7dfa-4561-ab7e-c12392dc70eb admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:25.398880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803b71-f35c-421c-8efc-93d3c5167989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:25.399486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803b71-f35c-421c-8efc-93d3c5167989 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:25.399816 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803b71-f35c-421c-8efc-93d3c5167989 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:25.400108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803b71-f35c-421c-8efc-93d3c5167989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:25.410359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803b71-f35c-421c-8efc-93d3c5167989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:25.446748 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803b71-f35c-421c-8efc-93d3c5167989 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:25.459541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1059/2111] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:25.620545 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef26f5-4605-43d9-a2b9-fac40765d73d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:25.621954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-68ef26f5-4605-43d9-a2b9-fac40765d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:25.640585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef26f5-4605-43d9-a2b9-fac40765d73d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:25.647540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:25.648345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:25.648687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:25.649014 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] PATH_INFO: `/v3/users/a906ddeb796f4af5a8506572fcdfcdd8` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:25.651250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a906ddeb796f4af5a8506572fcdfcdd8)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:25.690908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:25.768846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a906ddeb796f4af5a8506572fcdfcdd8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.791006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a906ddeb796f4af5a8506572fcdfcdd8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.792353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a906ddeb796f4af5a8506572fcdfcdd8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.810357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a906ddeb796f4af5a8506572fcdfcdd8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.826865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d94868ad-53bd-4261-afa7-cce476b51606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a906ddeb796f4af5a8506572fcdfcdd8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:25.838814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1053/2112] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:25 2021] DELETE /identity/v3/users/a906ddeb796f4af5a8506572fcdfcdd8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:25.844670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c349a6-b08e-4139-8c9d-49c6a55ca211 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:25.844984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c349a6-b08e-4139-8c9d-49c6a55ca211 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:25.845648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c349a6-b08e-4139-8c9d-49c6a55ca211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:25.875746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-81c349a6-b08e-4139-8c9d-49c6a55ca211 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:25.877069 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-81c349a6-b08e-4139-8c9d-49c6a55ca211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:25.963683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d76ad-896b-49d6-ad8a-e480c357a302 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:25.964174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d76ad-896b-49d6-ad8a-e480c357a302 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:25.964665 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d76ad-896b-49d6-ad8a-e480c357a302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:25.990182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1060/2113] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:25.998613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-cd3d76ad-896b-49d6-ad8a-e480c357a302 None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:25.999818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cd3d76ad-896b-49d6-ad8a-e480c357a302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:26.006859 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c349a6-b08e-4139-8c9d-49c6a55ca211 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:26.008559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-81c349a6-b08e-4139-8c9d-49c6a55ca211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:26.101203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c349a6-b08e-4139-8c9d-49c6a55ca211 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:26.106068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1054/2114] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:13:25 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:26.117059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057a38f-515d-40cf-918f-f409f334bcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:26.119213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a38f-515d-40cf-918f-f409f334bcaf service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:26.119724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a38f-515d-40cf-918f-f409f334bcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:26.120224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057a38f-515d-40cf-918f-f409f334bcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:26.139046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057a38f-515d-40cf-918f-f409f334bcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:26.172247 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057a38f-515d-40cf-918f-f409f334bcaf service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:26.177279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d76ad-896b-49d6-ad8a-e480c357a302 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:26.178699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cd3d76ad-896b-49d6-ad8a-e480c357a302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:26.190836 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1061/2115] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:26.333954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d76ad-896b-49d6-ad8a-e480c357a302 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:26.352407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b7dc0-f4db-49e8-b879-be7d700bac3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:26.352941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7dc0-f4db-49e8-b879-be7d700bac3f service swift] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:26.353229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7dc0-f4db-49e8-b879-be7d700bac3f service swift] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:26.353508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7dc0-f4db-49e8-b879-be7d700bac3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:26.382355 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b7dc0-f4db-49e8-b879-be7d700bac3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:26.426569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b7dc0-f4db-49e8-b879-be7d700bac3f service swift] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:26.464470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1055/2116] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:13:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:13:26.482112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057a38f-515d-40cf-918f-f409f334bcaf service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:26.483607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5057a38f-515d-40cf-918f-f409f334bcaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:26.504250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057a38f-515d-40cf-918f-f409f334bcaf service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:26.515998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:26.516865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:26.517148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:26.517423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] PATH_INFO: `/v3/projects/3183f3c1bafd463a94bc9f3883744e10` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:26.521954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3183f3c1bafd463a94bc9f3883744e10)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:26.571880 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:26.752525 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3183f3c1bafd463a94bc9f3883744e10', 'request_id': 'req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:26.783870 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3183f3c1bafd463a94bc9f3883744e10', 'request_id': 'req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:26.794462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3183f3c1bafd463a94bc9f3883744e10', 'request_id': 'req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:26.816070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] The token cache is being invalidate because project 3183f3c1bafd463a94bc9f3883744e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:26.816767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:26.819250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:26.823347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1062/2117] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:26 2021] DELETE /identity/v3/projects/3183f3c1bafd463a94bc9f3883744e10 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:26.827265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b7dc0-f4db-49e8-b879-be7d700bac3f service swift] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:26.844277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b7dc0-f4db-49e8-b879-be7d700bac3f service swift] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:27.085736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:27.086796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:27.087291 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:27.087869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] PATH_INFO: `/v3/users/060f415920fb477185589723d3601a8e` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:27.091203 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060f415920fb477185589723d3601a8e)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:27.150406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:27.277392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:27.280593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060f415920fb477185589723d3601a8e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.284349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:27.316021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060f415920fb477185589723d3601a8e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.316669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1f6c2-1526-494d-ae05-b3846c7a35e4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:27.318730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060f415920fb477185589723d3601a8e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.325907 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:27.327759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:27.328128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:27.330503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] PATH_INFO: `/v3/projects/7bc6b1b4ce944be4bd2c2a4db0a3446c` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:27.333650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc6b1b4ce944be4bd2c2a4db0a3446c)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:27.339587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060f415920fb477185589723d3601a8e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.354747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060f415920fb477185589723d3601a8e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.372180 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1056/2118] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:26 2021] DELETE /identity/v3/users/060f415920fb477185589723d3601a8e => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:27.372715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:27.462454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc6b1b4ce944be4bd2c2a4db0a3446c', 'request_id': 'req-684db638-0ffe-4bc5-a037-dcb3ba8b451a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.478236 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc6b1b4ce944be4bd2c2a4db0a3446c', 'request_id': 'req-684db638-0ffe-4bc5-a037-dcb3ba8b451a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.502256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc6b1b4ce944be4bd2c2a4db0a3446c', 'request_id': 'req-684db638-0ffe-4bc5-a037-dcb3ba8b451a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.516336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] The token cache is being invalidate because project 7bc6b1b4ce944be4bd2c2a4db0a3446c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:27.516891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.518429 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-684db638-0ffe-4bc5-a037-dcb3ba8b451a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:27.521420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1063/2119] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:27 2021] DELETE /identity/v3/projects/7bc6b1b4ce944be4bd2c2a4db0a3446c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:27.525681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:27.530141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:27.790272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a85ca3-f4c1-4ea4-bc0b-189399325bb2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:27.936910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:27.938147 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:27.938760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:27.939481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] PATH_INFO: `/v3/users/1af4b31167494a928251faf48c15b8a7` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:27.941286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af4b31167494a928251faf48c15b8a7)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:27.975186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:28.012003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcc31f-415c-45cf-93a1-745855934a25 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:28.012375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcc31f-415c-45cf-93a1-745855934a25 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:28.012750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcc31f-415c-45cf-93a1-745855934a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:28.057620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-47bcc31f-415c-45cf-93a1-745855934a25 None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:28.058805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af4b31167494a928251faf48c15b8a7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.059952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-47bcc31f-415c-45cf-93a1-745855934a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:28.080620 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af4b31167494a928251faf48c15b8a7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.081322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af4b31167494a928251faf48c15b8a7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.091987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af4b31167494a928251faf48c15b8a7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.102355 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af4b31167494a928251faf48c15b8a7'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.117510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1057/2120] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:27 2021] DELETE /identity/v3/users/1af4b31167494a928251faf48c15b8a7 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:28.178976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1064/2121] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:13:28 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:28.202361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:28.204085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:28.368693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6457-bfe3-4936-a251-474f9232f85a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:28.374348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec504c-3f57-4961-a421-51295c3adc8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:28.375130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec504c-3f57-4961-a421-51295c3adc8c service swift] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:28.375527 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec504c-3f57-4961-a421-51295c3adc8c service swift] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:28.375956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec504c-3f57-4961-a421-51295c3adc8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:28.425854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcc31f-415c-45cf-93a1-745855934a25 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:28.430187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-47bcc31f-415c-45cf-93a1-745855934a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:28.454309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcc31f-415c-45cf-93a1-745855934a25 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:28.515382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec504c-3f57-4961-a421-51295c3adc8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:28.574715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec504c-3f57-4961-a421-51295c3adc8c service swift] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:28.590792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1058/2122] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:13:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:13:28.607722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:28.608523 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:28.608815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:28.609104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] PATH_INFO: `/v3/projects/a55dd3eb90f74d90a6ed2d1042f2cc09` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:28.610333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55dd3eb90f74d90a6ed2d1042f2cc09)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:28.651735 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:28.788476 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55dd3eb90f74d90a6ed2d1042f2cc09', 'request_id': 'req-8fffca7f-4c86-4e1d-ba76-0d3087633124'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.845029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55dd3eb90f74d90a6ed2d1042f2cc09', 'request_id': 'req-8fffca7f-4c86-4e1d-ba76-0d3087633124'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.870585 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55dd3eb90f74d90a6ed2d1042f2cc09', 'request_id': 'req-8fffca7f-4c86-4e1d-ba76-0d3087633124'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.913357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] The token cache is being invalidate because project a55dd3eb90f74d90a6ed2d1042f2cc09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:28.913660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.915861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec504c-3f57-4961-a421-51295c3adc8c service swift] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:28.917280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-eeec504c-3f57-4961-a421-51295c3adc8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:28.950783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8fffca7f-4c86-4e1d-ba76-0d3087633124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:28.967758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1065/2123] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:28 2021] DELETE /identity/v3/projects/a55dd3eb90f74d90a6ed2d1042f2cc09 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:28.986369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4b7ec-fbe0-47fd-8cff-1065ab96bd24 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:28.987612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4b7ec-fbe0-47fd-8cff-1065ab96bd24 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:28.987907 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4b7ec-fbe0-47fd-8cff-1065ab96bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:28.989968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec504c-3f57-4961-a421-51295c3adc8c service swift] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:29.077311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7dc4b7ec-fbe0-47fd-8cff-1065ab96bd24 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:29.097332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7dc4b7ec-fbe0-47fd-8cff-1065ab96bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:29.274097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:29.274964 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:29.275253 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:29.275534 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] PATH_INFO: `/v3/projects/7496ee0d7ae240c29f93537b1d679402` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:29.277592 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7496ee0d7ae240c29f93537b1d679402)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:29.335425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1066/2124] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:29.336522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:29.337151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399eabd-f6a3-4f0d-bfb1-c68e893d02e0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:29.337553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399eabd-f6a3-4f0d-bfb1-c68e893d02e0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:29.337938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399eabd-f6a3-4f0d-bfb1-c68e893d02e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:29.392391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2399eabd-f6a3-4f0d-bfb1-c68e893d02e0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:29.398805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2399eabd-f6a3-4f0d-bfb1-c68e893d02e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:29.425197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1067/2125] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:29.431111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ea820-7f48-49fc-bbd0-455283e94973 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:29.431713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ea820-7f48-49fc-bbd0-455283e94973 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:29.431713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ea820-7f48-49fc-bbd0-455283e94973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:29.455217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7496ee0d7ae240c29f93537b1d679402', 'request_id': 'req-48379f18-37ec-42c6-9f8b-115c8f8d75b0'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.481111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7496ee0d7ae240c29f93537b1d679402', 'request_id': 'req-48379f18-37ec-42c6-9f8b-115c8f8d75b0'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.488671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-491ea820-7f48-49fc-bbd0-455283e94973 None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:29.492167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-491ea820-7f48-49fc-bbd0-455283e94973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:29.496445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7496ee0d7ae240c29f93537b1d679402', 'request_id': 'req-48379f18-37ec-42c6-9f8b-115c8f8d75b0'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.517073 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] The token cache is being invalidate because project 7496ee0d7ae240c29f93537b1d679402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:29.517377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.519943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.527440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1059/2126] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:28 2021] DELETE /identity/v3/projects/7496ee0d7ae240c29f93537b1d679402 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:29.527440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:29.532382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:29.595889 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1068/2127] 10.222.0.36 () {58 vars in 967 bytes} [Wed Oct 27 14:13:29 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:29.596952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ea820-7f48-49fc-bbd0-455283e94973 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:29.599099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-491ea820-7f48-49fc-bbd0-455283e94973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:29.641917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48379f18-37ec-42c6-9f8b-115c8f8d75b0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:29.648266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:29.648969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:29.649271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:29.649566 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:29.650770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:29.651152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:29.687954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:29.705849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1060/2128] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:29.706992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:29.709475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:29.709875 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ea820-7f48-49fc-bbd0-455283e94973 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:29.717068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:29.718061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:29.718391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:29.718705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] PATH_INFO: `/v3/users/6ed32d54156e4358a4aa1839163b9b75` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:29.719906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed32d54156e4358a4aa1839163b9b75)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:29.751562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:29.809989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ae371-9629-4b3c-904a-eb7a1393fa67 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:29.816097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f451ec-a17f-472c-b49b-c016c047b402 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:29.816799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f451ec-a17f-472c-b49b-c016c047b402 service swift] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:29.817862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f451ec-a17f-472c-b49b-c016c047b402 service swift] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:29.820497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f451ec-a17f-472c-b49b-c016c047b402 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:29.834461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f451ec-a17f-472c-b49b-c016c047b402 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:29.845712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed32d54156e4358a4aa1839163b9b75'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.868179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed32d54156e4358a4aa1839163b9b75'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.868799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f451ec-a17f-472c-b49b-c016c047b402 service swift] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:29.870759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed32d54156e4358a4aa1839163b9b75'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.887114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed32d54156e4358a4aa1839163b9b75'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.887961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1061/2129] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:13:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:13:29.889044 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f451ec-a17f-472c-b49b-c016c047b402 service swift] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:29.901358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2a98c9d7-04f3-4e11-8200-3f89e80fa3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed32d54156e4358a4aa1839163b9b75'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:29.903459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f451ec-a17f-472c-b49b-c016c047b402 service swift] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:29.908365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce67640-50a7-44b0-bea7-c50b55222156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:29.909768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67640-50a7-44b0-bea7-c50b55222156 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:29.910438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67640-50a7-44b0-bea7-c50b55222156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:29.911886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67640-50a7-44b0-bea7-c50b55222156 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:29.912783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce67640-50a7-44b0-bea7-c50b55222156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:29.913084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1069/2130] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:29 2021] DELETE /identity/v3/users/6ed32d54156e4358a4aa1839163b9b75 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:29.952392 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce67640-50a7-44b0-bea7-c50b55222156 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:29.975203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1060f6c-a84d-42bb-b3a6-641135b9a192 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:29.975852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1060f6c-a84d-42bb-b3a6-641135b9a192 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:29.976181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1060f6c-a84d-42bb-b3a6-641135b9a192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:30.017334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1062/2131] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:29 2021] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:30.018488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce67640-50a7-44b0-bea7-c50b55222156 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:30.022029 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0ce67640-50a7-44b0-bea7-c50b55222156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:30.111683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c1060f6c-a84d-42bb-b3a6-641135b9a192 None None] MFA Rules not processed for user `9c7d443e8f994d25b9827efb1b4919bd`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:30.113132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c1060f6c-a84d-42bb-b3a6-641135b9a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:30.168234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce67640-50a7-44b0-bea7-c50b55222156 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:30.173552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3596f-61cc-4b26-90bb-dd5aae8d0307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:30.174397 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3596f-61cc-4b26-90bb-dd5aae8d0307 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:30.174866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3596f-61cc-4b26-90bb-dd5aae8d0307 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:30.175550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3596f-61cc-4b26-90bb-dd5aae8d0307 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:30.176357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3596f-61cc-4b26-90bb-dd5aae8d0307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:30.209016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3596f-61cc-4b26-90bb-dd5aae8d0307 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:30.261466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1063/2132] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:30 2021] POST /identity/v3/users => generated 281 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:30.265522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3596f-61cc-4b26-90bb-dd5aae8d0307 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:30.289869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3596f-61cc-4b26-90bb-dd5aae8d0307 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:30.307292 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4e99f-383d-438c-adec-eb7b8dc09f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:30.308536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4e99f-383d-438c-adec-eb7b8dc09f2b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:30.309000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4e99f-383d-438c-adec-eb7b8dc09f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:30.309574 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4e99f-383d-438c-adec-eb7b8dc09f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:30.310440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4e99f-383d-438c-adec-eb7b8dc09f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:30.326156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1070/2133] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:29 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:30.328605 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c938-577d-447b-b615-e7b3133fdcfd None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:30.329088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c938-577d-447b-b615-e7b3133fdcfd None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:30.329595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c938-577d-447b-b615-e7b3133fdcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:30.368690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-e3a0c938-577d-447b-b615-e7b3133fdcfd None None] MFA Rules not processed for user `9c7d443e8f994d25b9827efb1b4919bd`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:30.370608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e3a0c938-577d-447b-b615-e7b3133fdcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:30.389779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1071/2134] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:30 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:30.390998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c938-577d-447b-b615-e7b3133fdcfd None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:30.392551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e3a0c938-577d-447b-b615-e7b3133fdcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:30.404038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4e99f-383d-438c-adec-eb7b8dc09f2b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:30.444296 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1064/2135] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:30 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:30.445348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4e99f-383d-438c-adec-eb7b8dc09f2b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:30.466676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4e99f-383d-438c-adec-eb7b8dc09f2b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:30.481112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d3e4f-d719-403f-9729-b9535bbbbdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:30.483414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d3e4f-d719-403f-9729-b9535bbbbdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:30.483820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d3e4f-d719-403f-9729-b9535bbbbdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:30.484346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d3e4f-d719-403f-9729-b9535bbbbdd4 admin admin] PATH_INFO: `/v3/projects/2bb98af9381b4455b56c10ee99f2defd/users/686dbbb9432e44439aa30ef8bffd77eb/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:30.521331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d3e4f-d719-403f-9729-b9535bbbbdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb98af9381b4455b56c10ee99f2defd, user_id=686dbbb9432e44439aa30ef8bffd77eb, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:30.562013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c938-577d-447b-b615-e7b3133fdcfd None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:30.570322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbe964-fe17-4aa4-b47a-03d8489fccb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:30.571156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbe964-fe17-4aa4-b47a-03d8489fccb0 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:30.571598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbe964-fe17-4aa4-b47a-03d8489fccb0 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:30.572049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbe964-fe17-4aa4-b47a-03d8489fccb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:30.580774 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d3e4f-d719-403f-9729-b9535bbbbdd4 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:30.597568 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbe964-fe17-4aa4-b47a-03d8489fccb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:30.625251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1065/2136] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:30 2021] PUT /identity/v3/projects/2bb98af9381b4455b56c10ee99f2defd/users/686dbbb9432e44439aa30ef8bffd77eb/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:30.625251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d3e4f-d719-403f-9729-b9535bbbbdd4 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:30.625251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ef6d3e4f-d719-403f-9729-b9535bbbbdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:30.643904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbe964-fe17-4aa4-b47a-03d8489fccb0 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:30.658131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1072/2137] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:30 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:30.659517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592ef37-755c-434e-93f9-bc55b8da71a0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:30.659888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592ef37-755c-434e-93f9-bc55b8da71a0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:30.660244 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592ef37-755c-434e-93f9-bc55b8da71a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:30.702161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0592ef37-755c-434e-93f9-bc55b8da71a0 None None] MFA Rules not processed for user `686dbbb9432e44439aa30ef8bffd77eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:30.703460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0592ef37-755c-434e-93f9-bc55b8da71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:30.736078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d3e4f-d719-403f-9729-b9535bbbbdd4 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:30.743307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:30.744547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:30.745018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:30.745460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] PATH_INFO: `/v3/projects/d16e160370584bc0a73c518314fc12ce` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:30.746758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16e160370584bc0a73c518314fc12ce)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:30.803404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:30.826358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1073/2138] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:30 2021] POST /identity/v3/auth/tokens => generated 3668 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:30.832115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592ef37-755c-434e-93f9-bc55b8da71a0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:30.834207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0592ef37-755c-434e-93f9-bc55b8da71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:30.863037 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592ef37-755c-434e-93f9-bc55b8da71a0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:30.886408 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:30.892339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:30.894909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:30.896519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] PATH_INFO: `/v3/users/26207d11f27a4df595db7a10f68084bf` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:30.898025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26207d11f27a4df595db7a10f68084bf)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:30.919353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16e160370584bc0a73c518314fc12ce', 'request_id': 'req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:30.945599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:30.954036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16e160370584bc0a73c518314fc12ce', 'request_id': 'req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:30.969755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16e160370584bc0a73c518314fc12ce', 'request_id': 'req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:31.017880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] The token cache is being invalidate because project d16e160370584bc0a73c518314fc12ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:31.018821 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:31.019557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-33c9d0d6-c501-4d90-a893-7ddb2c805e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:31.024035 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1066/2139] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:30 2021] DELETE /identity/v3/projects/d16e160370584bc0a73c518314fc12ce => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:31.030106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ca8f3-0ddc-4438-b0cb-aa5a45b4fdb0 None None] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:31.030457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ca8f3-0ddc-4438-b0cb-aa5a45b4fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:31.032415 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ca8f3-0ddc-4438-b0cb-aa5a45b4fdb0 None None] PATH_INFO: `/` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:31.043715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1067/2140] 10.222.0.36 () {54 vars in 961 bytes} [Wed Oct 27 14:13:31 2021] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:13:31.045055 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46564fb-bcd8-44ab-b6cc-4e7bec5242fe None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:31.045406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46564fb-bcd8-44ab-b6cc-4e7bec5242fe None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:31.045754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46564fb-bcd8-44ab-b6cc-4e7bec5242fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:31.065956 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26207d11f27a4df595db7a10f68084bf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:31.101989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26207d11f27a4df595db7a10f68084bf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:31.103804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26207d11f27a4df595db7a10f68084bf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:31.108942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e46564fb-bcd8-44ab-b6cc-4e7bec5242fe None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:31.113138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e46564fb-bcd8-44ab-b6cc-4e7bec5242fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:31.124129 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26207d11f27a4df595db7a10f68084bf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:31.142255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-40e41e31-9304-40f4-9240-404f3b2d0388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26207d11f27a4df595db7a10f68084bf'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:31.157796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1074/2141] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:30 2021] DELETE /identity/v3/users/26207d11f27a4df595db7a10f68084bf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:31.162188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426a67-4446-461e-8638-1e6aa7d9f762 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:31.163033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426a67-4446-461e-8638-1e6aa7d9f762 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:31.163764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426a67-4446-461e-8638-1e6aa7d9f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:31.211867 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-56426a67-4446-461e-8638-1e6aa7d9f762 None None] MFA Rules not processed for user `3c014f6c51ed4c99a1a4450dde18cbef`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:31.215538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-56426a67-4446-461e-8638-1e6aa7d9f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:31.298882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1068/2142] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:31.298882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb514-413a-4f60-8cac-2c1712302838 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:31.298882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb514-413a-4f60-8cac-2c1712302838 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:31.298882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb514-413a-4f60-8cac-2c1712302838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:31.334838 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c14cb514-413a-4f60-8cac-2c1712302838 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:31.340030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c14cb514-413a-4f60-8cac-2c1712302838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:31.361233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1075/2143] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Oct 27 14:13:31 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:31.364823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f2526-ae81-496f-b2de-6ca5954da059 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:31.365968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f2526-ae81-496f-b2de-6ca5954da059 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:31.366798 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f2526-ae81-496f-b2de-6ca5954da059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:31.421525 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7c8f2526-ae81-496f-b2de-6ca5954da059 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:31.424225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7c8f2526-ae81-496f-b2de-6ca5954da059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:31.523334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1069/2144] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:31.524270 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cb514-413a-4f60-8cac-2c1712302838 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:31.561195 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cb514-413a-4f60-8cac-2c1712302838 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:31.571414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab606411-6c09-4eb8-8b05-57b7ce8866c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:31.572220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab606411-6c09-4eb8-8b05-57b7ce8866c1 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:31.572562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab606411-6c09-4eb8-8b05-57b7ce8866c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:31.572825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab606411-6c09-4eb8-8b05-57b7ce8866c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:31.575897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ab606411-6c09-4eb8-8b05-57b7ce8866c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:31.581349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1076/2145] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:31.584426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f2526-ae81-496f-b2de-6ca5954da059 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:31.590084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7c8f2526-ae81-496f-b2de-6ca5954da059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:31.749977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab606411-6c09-4eb8-8b05-57b7ce8866c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:31.821327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f2526-ae81-496f-b2de-6ca5954da059 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:31.823893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab606411-6c09-4eb8-8b05-57b7ce8866c1 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:31.827760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c4758-b8f7-4c75-8043-ff0eb09d4ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:31.831883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c4758-b8f7-4c75-8043-ff0eb09d4ffd service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:31.832520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c4758-b8f7-4c75-8043-ff0eb09d4ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:31.833632 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c4758-b8f7-4c75-8043-ff0eb09d4ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:31.848020 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1070/2146] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:31 2021] GET /identity/v3/auth/tokens => generated 3668 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:31.849585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab606411-6c09-4eb8-8b05-57b7ce8866c1 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:31.852533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c4758-b8f7-4c75-8043-ff0eb09d4ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:31.876088 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab606411-6c09-4eb8-8b05-57b7ce8866c1 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:31.891812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe0826-ce61-4710-85e7-5f34e8031f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:31.892519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0826-ce61-4710-85e7-5f34e8031f7a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:31.892858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0826-ce61-4710-85e7-5f34e8031f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:31.893247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0826-ce61-4710-85e7-5f34e8031f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:31.893995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe0826-ce61-4710-85e7-5f34e8031f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:31.894296 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe0826-ce61-4710-85e7-5f34e8031f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:31.962123 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c4758-b8f7-4c75-8043-ff0eb09d4ffd service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:31.967306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe0826-ce61-4710-85e7-5f34e8031f7a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:31.998696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1071/2147] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:32.005234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe0826-ce61-4710-85e7-5f34e8031f7a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:32.022243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe0826-ce61-4710-85e7-5f34e8031f7a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:32.035515 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1077/2148] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:32.036796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00fa89-6fed-43ad-8e71-25e2eb06fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:32.037408 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00fa89-6fed-43ad-8e71-25e2eb06fb59 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:32.037699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00fa89-6fed-43ad-8e71-25e2eb06fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:32.037977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00fa89-6fed-43ad-8e71-25e2eb06fb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:32.038642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00fa89-6fed-43ad-8e71-25e2eb06fb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:32.092185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00fa89-6fed-43ad-8e71-25e2eb06fb59 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:32.169119 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1072/2149] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:32 2021] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:32.172953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c4758-b8f7-4c75-8043-ff0eb09d4ffd service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:32.187102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c4758-b8f7-4c75-8043-ff0eb09d4ffd service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:32.354956 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445b250-c932-4d1a-8554-556ef75816ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:32.355596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445b250-c932-4d1a-8554-556ef75816ab admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:32.355894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445b250-c932-4d1a-8554-556ef75816ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:32.356174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445b250-c932-4d1a-8554-556ef75816ab admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:32.356832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445b250-c932-4d1a-8554-556ef75816ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:32.396711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445b250-c932-4d1a-8554-556ef75816ab admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:32.456099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1078/2150] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:32 2021] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:32.462374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00fa89-6fed-43ad-8e71-25e2eb06fb59 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:32.481839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00fa89-6fed-43ad-8e71-25e2eb06fb59 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:32.484292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445b250-c932-4d1a-8554-556ef75816ab admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:32.488246 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8445b250-c932-4d1a-8554-556ef75816ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:32.504059 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce24f5d-68d5-4ec7-9e5a-23fbf1fec7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:32.505399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce24f5d-68d5-4ec7-9e5a-23fbf1fec7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:32.505898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce24f5d-68d5-4ec7-9e5a-23fbf1fec7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:32.506098 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce24f5d-68d5-4ec7-9e5a-23fbf1fec7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:32.506428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445b250-c932-4d1a-8554-556ef75816ab admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:32.506869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce24f5d-68d5-4ec7-9e5a-23fbf1fec7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:32.513904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:32.514754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:32.515047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:32.515332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] PATH_INFO: `/v3/users/686dbbb9432e44439aa30ef8bffd77eb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:32.524939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686dbbb9432e44439aa30ef8bffd77eb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:32.561099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:32.561238 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce24f5d-68d5-4ec7-9e5a-23fbf1fec7c0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:32.583036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1073/2151] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:32 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:32.583036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827d4ee-735d-4c7f-9102-ef3fadf27f38 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:32.583036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827d4ee-735d-4c7f-9102-ef3fadf27f38 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:32.583036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827d4ee-735d-4c7f-9102-ef3fadf27f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:32.612495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5827d4ee-735d-4c7f-9102-ef3fadf27f38 None None] MFA Rules not processed for user `9c7d443e8f994d25b9827efb1b4919bd`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:32.618057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5827d4ee-735d-4c7f-9102-ef3fadf27f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:32.635007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686dbbb9432e44439aa30ef8bffd77eb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:32.654782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686dbbb9432e44439aa30ef8bffd77eb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:32.656253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686dbbb9432e44439aa30ef8bffd77eb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:32.667227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686dbbb9432e44439aa30ef8bffd77eb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:32.680315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686dbbb9432e44439aa30ef8bffd77eb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:32.690367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1079/2152] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:32 2021] DELETE /identity/v3/users/686dbbb9432e44439aa30ef8bffd77eb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:32.691486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:32.693998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:32.800215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1074/2153] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:32 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:32.804571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03df1d-d64a-41c1-9dfb-860dc6bdac76 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:32.804870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03df1d-d64a-41c1-9dfb-860dc6bdac76 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:32.805153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03df1d-d64a-41c1-9dfb-860dc6bdac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:32.813542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56bb2f-6608-4766-a3f9-77340a5285d9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:32.820288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac84d6a-411b-43b0-8234-d94158205498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:32.821288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac84d6a-411b-43b0-8234-d94158205498 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:32.821619 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac84d6a-411b-43b0-8234-d94158205498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:32.821915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac84d6a-411b-43b0-8234-d94158205498 admin admin] PATH_INFO: `/v3/projects/87cc677545b340939ea01d49be450645/users/3632ab392d4044f9ac15559560f8b082/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:32.849135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac84d6a-411b-43b0-8234-d94158205498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cc677545b340939ea01d49be450645, user_id=3632ab392d4044f9ac15559560f8b082, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:32.865529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7c03df1d-d64a-41c1-9dfb-860dc6bdac76 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:32.867998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7c03df1d-d64a-41c1-9dfb-860dc6bdac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:32.881190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1075/2154] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:32.881190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03df1d-d64a-41c1-9dfb-860dc6bdac76 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:32.881190 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7c03df1d-d64a-41c1-9dfb-860dc6bdac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:32.895771 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03df1d-d64a-41c1-9dfb-860dc6bdac76 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:32.896524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac84d6a-411b-43b0-8234-d94158205498 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:32.908852 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:32.909805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:32.911235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:32.911235 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] PATH_INFO: `/v3/users/56c4ff2c5f93426bba94433463064508` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:32.915474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c4ff2c5f93426bba94433463064508)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:32.922016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1080/2155] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:32 2021] PUT /identity/v3/projects/87cc677545b340939ea01d49be450645/users/3632ab392d4044f9ac15559560f8b082/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:32.922692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac84d6a-411b-43b0-8234-d94158205498 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:32.937673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9ac84d6a-411b-43b0-8234-d94158205498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:32.947854 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:33.045753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c4ff2c5f93426bba94433463064508'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.068108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c4ff2c5f93426bba94433463064508'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.071079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c4ff2c5f93426bba94433463064508'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.088498 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c4ff2c5f93426bba94433463064508'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.105348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a3cd53aa-2932-4d7e-8a76-7ea8f7e9c517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c4ff2c5f93426bba94433463064508'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.113300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac84d6a-411b-43b0-8234-d94158205498 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:33.119795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1076/2156] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:32 2021] DELETE /identity/v3/users/56c4ff2c5f93426bba94433463064508 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:33.121279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d11b0-9a03-4b37-a44c-170d671872c3 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:33.121585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d11b0-9a03-4b37-a44c-170d671872c3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:33.121878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d11b0-9a03-4b37-a44c-170d671872c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:33.143930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:33.144788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:33.146324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:33.146833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:33.152091 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:33.214431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-323d11b0-9a03-4b37-a44c-170d671872c3 None None] MFA Rules not processed for user `3632ab392d4044f9ac15559560f8b082`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:33.215654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-323d11b0-9a03-4b37-a44c-170d671872c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:33.319962 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1077/2157] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:33 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:33.321475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487a960-7533-43e1-b222-62a8051ebb25 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:33.322302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487a960-7533-43e1-b222-62a8051ebb25 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:33.322603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487a960-7533-43e1-b222-62a8051ebb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:33.325183 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:33.360797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-8487a960-7533-43e1-b222-62a8051ebb25 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:33.362240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8487a960-7533-43e1-b222-62a8051ebb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:33.402658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:33.415093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1081/2158] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:33.416594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:33.417873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:33.432465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436455a-39a9-4cba-9338-e03369d39821 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:33.512638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b48ae-7981-4240-81f1-34b5d51ab22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:33.513259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b48ae-7981-4240-81f1-34b5d51ab22e admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:33.513550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b48ae-7981-4240-81f1-34b5d51ab22e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:33.513865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b48ae-7981-4240-81f1-34b5d51ab22e admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:33.514594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b48ae-7981-4240-81f1-34b5d51ab22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:33.527540 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1078/2159] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:33.541396 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487a960-7533-43e1-b222-62a8051ebb25 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:33.547653 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8487a960-7533-43e1-b222-62a8051ebb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:33.577529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b48ae-7981-4240-81f1-34b5d51ab22e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:33.583673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487a960-7533-43e1-b222-62a8051ebb25 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:33.605895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:33.606735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:33.607021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:33.607328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] PATH_INFO: `/v3/projects/a3c6f753fc5e4a26a798885b5c3d4fd1` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:33.610470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c6f753fc5e4a26a798885b5c3d4fd1)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:33.619919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1082/2160] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:33 2021] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:33.621378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b48ae-7981-4240-81f1-34b5d51ab22e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:33.635759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a13b48ae-7981-4240-81f1-34b5d51ab22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:33.659657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:33.724971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c6f753fc5e4a26a798885b5c3d4fd1', 'request_id': 'req-c411a40c-0fd3-4dd8-9274-4743db2ff996'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.743688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c6f753fc5e4a26a798885b5c3d4fd1', 'request_id': 'req-c411a40c-0fd3-4dd8-9274-4743db2ff996'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.753927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c6f753fc5e4a26a798885b5c3d4fd1', 'request_id': 'req-c411a40c-0fd3-4dd8-9274-4743db2ff996'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.767456 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] The token cache is being invalidate because project a3c6f753fc5e4a26a798885b5c3d4fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:33.767984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.768738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:33.771879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1079/2161] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:33 2021] DELETE /identity/v3/projects/a3c6f753fc5e4a26a798885b5c3d4fd1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:33.771879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:33.774133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:33.807082 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b48ae-7981-4240-81f1-34b5d51ab22e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:33.989449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:33.991792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:33.992348 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:33.992838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:33.999816 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:34.009210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411a40c-0fd3-4dd8-9274-4743db2ff996 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:34.023952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:34.034198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c78af-4b11-4a64-873a-a6c65a8c8bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:34.035347 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c78af-4b11-4a64-873a-a6c65a8c8bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:34.035725 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c78af-4b11-4a64-873a-a6c65a8c8bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:34.044141 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c78af-4b11-4a64-873a-a6c65a8c8bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:34.047013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c78af-4b11-4a64-873a-a6c65a8c8bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:34.081196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:34.108836 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1083/2162] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:34.113516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:34.117118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:34.147847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c78af-4b11-4a64-873a-a6c65a8c8bf8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:34.157942 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8529fe-e1e3-4c4b-ab29-3ee416342ee7 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:34.170904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:34.171860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:34.172946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:34.174088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] PATH_INFO: `/v3/users/049317a8dd124f55874cbcd2fe3c1173` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:34.177164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=049317a8dd124f55874cbcd2fe3c1173)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:34.200538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1080/2163] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:33 2021] POST /identity/v3/users => generated 293 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:34.202005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c78af-4b11-4a64-873a-a6c65a8c8bf8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:34.221094 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c78af-4b11-4a64-873a-a6c65a8c8bf8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:34.231957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a7c3-5edd-458a-9148-f65121bf5b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:34.232578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a7c3-5edd-458a-9148-f65121bf5b68 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:34.233414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a7c3-5edd-458a-9148-f65121bf5b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:34.233722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5a7c3-5edd-458a-9148-f65121bf5b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:34.234449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5a7c3-5edd-458a-9148-f65121bf5b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:34.245584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:34.297768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5a7c3-5edd-458a-9148-f65121bf5b68 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:34.324464 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1081/2164] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:34 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:13:34.328416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a7c3-5edd-458a-9148-f65121bf5b68 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:34.351184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5a7c3-5edd-458a-9148-f65121bf5b68 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:34.374078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049317a8dd124f55874cbcd2fe3c1173'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.383048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778bcc8-ed91-4907-82ed-ad4035572618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:34.383722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778bcc8-ed91-4907-82ed-ad4035572618 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:34.384150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778bcc8-ed91-4907-82ed-ad4035572618 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:34.384448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778bcc8-ed91-4907-82ed-ad4035572618 admin admin] PATH_INFO: `/v3/projects/97b0e119d0114eb39e36d3022611f4e1/users/1a2037c18b0346088c1782e67b4618ca/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:34.412099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049317a8dd124f55874cbcd2fe3c1173'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.414671 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049317a8dd124f55874cbcd2fe3c1173'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.441538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049317a8dd124f55874cbcd2fe3c1173'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.460825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049317a8dd124f55874cbcd2fe3c1173'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.495582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1084/2165] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:34 2021] DELETE /identity/v3/users/049317a8dd124f55874cbcd2fe3c1173 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:34.514985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778bcc8-ed91-4907-82ed-ad4035572618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b0e119d0114eb39e36d3022611f4e1, user_id=1a2037c18b0346088c1782e67b4618ca, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:34.548607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:34.550093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:34.574870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778bcc8-ed91-4907-82ed-ad4035572618 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:34.598378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1082/2166] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:34 2021] PUT /identity/v3/projects/97b0e119d0114eb39e36d3022611f4e1/users/1a2037c18b0346088c1782e67b4618ca/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:34.608471 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663335-61c5-4740-bd51-344e0eb0111c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:34.608853 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663335-61c5-4740-bd51-344e0eb0111c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:34.609203 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663335-61c5-4740-bd51-344e0eb0111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:34.678548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54407b-205f-41bd-b8cc-e506347c6d4d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:34.682461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-96663335-61c5-4740-bd51-344e0eb0111c None None] MFA Rules not processed for user `1a2037c18b0346088c1782e67b4618ca`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:34.683911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-96663335-61c5-4740-bd51-344e0eb0111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:34.756410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:34.757353 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:34.757651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:34.757994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] PATH_INFO: `/v3/projects/2bb98af9381b4455b56c10ee99f2defd` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:34.759170 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb98af9381b4455b56c10ee99f2defd)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:34.789448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:34.899036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb98af9381b4455b56c10ee99f2defd', 'request_id': 'req-a1901d94-9c69-4177-a172-14ad40f4eb5d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.935368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb98af9381b4455b56c10ee99f2defd', 'request_id': 'req-a1901d94-9c69-4177-a172-14ad40f4eb5d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.948856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb98af9381b4455b56c10ee99f2defd', 'request_id': 'req-a1901d94-9c69-4177-a172-14ad40f4eb5d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.949639 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1083/2167] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:34 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:34.954451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663335-61c5-4740-bd51-344e0eb0111c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:34.962179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-96663335-61c5-4740-bd51-344e0eb0111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:34.965621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] The token cache is being invalidate because project 2bb98af9381b4455b56c10ee99f2defd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:34.965913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.967017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a1901d94-9c69-4177-a172-14ad40f4eb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:34.968566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1085/2168] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:34 2021] DELETE /identity/v3/projects/2bb98af9381b4455b56c10ee99f2defd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:34.977404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747844e-cbcf-4773-8b5c-6488cd8b5185 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:34.977778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747844e-cbcf-4773-8b5c-6488cd8b5185 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:34.978125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747844e-cbcf-4773-8b5c-6488cd8b5185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:34.994406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663335-61c5-4740-bd51-344e0eb0111c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:35.061477 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-4747844e-cbcf-4773-8b5c-6488cd8b5185 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:35.062638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4747844e-cbcf-4773-8b5c-6488cd8b5185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:35.087520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f0c5-dd6d-47b1-9c99-9783b5376403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:35.088874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f0c5-dd6d-47b1-9c99-9783b5376403 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:35.089444 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f0c5-dd6d-47b1-9c99-9783b5376403 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:35.090107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f0c5-dd6d-47b1-9c99-9783b5376403 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:35.091199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f0c5-dd6d-47b1-9c99-9783b5376403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:35.133626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f0c5-dd6d-47b1-9c99-9783b5376403 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:35.172691 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1084/2169] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:34 2021] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:35.176703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f0c5-dd6d-47b1-9c99-9783b5376403 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:35.180038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-42c1f0c5-dd6d-47b1-9c99-9783b5376403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:35.284870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f0c5-dd6d-47b1-9c99-9783b5376403 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:35.297898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c855c9-0335-49cd-a9a9-848af8421224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:35.298652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c855c9-0335-49cd-a9a9-848af8421224 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:35.298959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c855c9-0335-49cd-a9a9-848af8421224 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:35.299395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c855c9-0335-49cd-a9a9-848af8421224 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:35.300277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c855c9-0335-49cd-a9a9-848af8421224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:35.302573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1086/2170] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:35.303643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747844e-cbcf-4773-8b5c-6488cd8b5185 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:35.304852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4747844e-cbcf-4773-8b5c-6488cd8b5185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:35.331762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747844e-cbcf-4773-8b5c-6488cd8b5185 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:35.341658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c855c9-0335-49cd-a9a9-848af8421224 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:35.350989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:35.351977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:35.351977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:35.352318 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] PATH_INFO: `/v3/projects/81296579f14a4a48b8b614a1672cfdae` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:35.353575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81296579f14a4a48b8b614a1672cfdae)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:35.396652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:35.398659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1085/2171] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:35 2021] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:35.400132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9f74b-e92b-4970-9c39-ad16343d7c7c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:35.400435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9f74b-e92b-4970-9c39-ad16343d7c7c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:35.400742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9f74b-e92b-4970-9c39-ad16343d7c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:35.457551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-35b9f74b-e92b-4970-9c39-ad16343d7c7c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:35.462904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-35b9f74b-e92b-4970-9c39-ad16343d7c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:35.483440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1086/2172] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:35.484655 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9f74b-e92b-4970-9c39-ad16343d7c7c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:35.499749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9f74b-e92b-4970-9c39-ad16343d7c7c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:35.511007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81296579f14a4a48b8b614a1672cfdae', 'request_id': 'req-9c3def2a-4242-4863-b2a0-285374329ae0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.537110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81296579f14a4a48b8b614a1672cfdae', 'request_id': 'req-9c3def2a-4242-4863-b2a0-285374329ae0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.548063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81296579f14a4a48b8b614a1672cfdae', 'request_id': 'req-9c3def2a-4242-4863-b2a0-285374329ae0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.562610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] The token cache is being invalidate because project 81296579f14a4a48b8b614a1672cfdae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:35.562977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.564277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.566393 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1087/2173] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:35 2021] DELETE /identity/v3/projects/81296579f14a4a48b8b614a1672cfdae => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:35.567565 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:35.569070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:35.592667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3c90-b82b-4823-b26f-55def1fe08a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:35.593288 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3c90-b82b-4823-b26f-55def1fe08a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:35.606363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3c90-b82b-4823-b26f-55def1fe08a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:35.607023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3c90-b82b-4823-b26f-55def1fe08a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:35.607499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d3c90-b82b-4823-b26f-55def1fe08a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:35.668537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3def2a-4242-4863-b2a0-285374329ae0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:35.683726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d3c90-b82b-4823-b26f-55def1fe08a8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:35.684025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:35.686760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:35.687292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:35.687601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] PATH_INFO: `/v3/users/eb33b92997474322a0e9bd62bc3a5e7b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:35.689394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb33b92997474322a0e9bd62bc3a5e7b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:35.704984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1087/2174] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:35 2021] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:35.706227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3c90-b82b-4823-b26f-55def1fe08a8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:35.712386 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ba0d3c90-b82b-4823-b26f-55def1fe08a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:35.727636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:35.740520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d3c90-b82b-4823-b26f-55def1fe08a8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:35.749783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7d49e-5870-489c-9231-1a6f34a18eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:35.750400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7d49e-5870-489c-9231-1a6f34a18eab admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:35.750719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7d49e-5870-489c-9231-1a6f34a18eab admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:35.751010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7d49e-5870-489c-9231-1a6f34a18eab admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:35.751707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7d49e-5870-489c-9231-1a6f34a18eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:35.752010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7d49e-5870-489c-9231-1a6f34a18eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:35.787873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7d49e-5870-489c-9231-1a6f34a18eab admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:35.793889 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb33b92997474322a0e9bd62bc3a5e7b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.804171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1088/2175] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:35.809845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcff79f-14ef-4d38-98dd-88294204d12a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:35.810166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcff79f-14ef-4d38-98dd-88294204d12a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:35.810601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcff79f-14ef-4d38-98dd-88294204d12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:35.829815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb33b92997474322a0e9bd62bc3a5e7b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.830972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb33b92997474322a0e9bd62bc3a5e7b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.841818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-efcff79f-14ef-4d38-98dd-88294204d12a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:35.843202 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-efcff79f-14ef-4d38-98dd-88294204d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:35.849132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb33b92997474322a0e9bd62bc3a5e7b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.855577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1089/2176] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:35.856571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcff79f-14ef-4d38-98dd-88294204d12a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:35.857945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-efcff79f-14ef-4d38-98dd-88294204d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:35.865419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb33b92997474322a0e9bd62bc3a5e7b'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:35.871618 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcff79f-14ef-4d38-98dd-88294204d12a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:35.873047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1088/2177] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:35 2021] DELETE /identity/v3/users/eb33b92997474322a0e9bd62bc3a5e7b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:35.874100 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:35.875426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.006726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe9b46-a85c-4fdf-84b3-464903e859bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:36.007567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9b46-a85c-4fdf-84b3-464903e859bf admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.007856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9b46-a85c-4fdf-84b3-464903e859bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.008139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9b46-a85c-4fdf-84b3-464903e859bf admin admin] PATH_INFO: `/v3/projects/0af58e5003124f899b7bcefba764df33/users/15ed691bfaa349289f86bd88c315d440/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.011003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fe10e-140b-42bc-a3f7-8c3fe1ad2205 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:36.027298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfad80-d371-4f39-ae01-c2b53c20d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:36.027916 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfad80-d371-4f39-ae01-c2b53c20d223 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.028205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfad80-d371-4f39-ae01-c2b53c20d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.028487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfad80-d371-4f39-ae01-c2b53c20d223 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.029157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfad80-d371-4f39-ae01-c2b53c20d223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:36.056746 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe9b46-a85c-4fdf-84b3-464903e859bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af58e5003124f899b7bcefba764df33, user_id=15ed691bfaa349289f86bd88c315d440, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:36.096815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfad80-d371-4f39-ae01-c2b53c20d223 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:36.106709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe9b46-a85c-4fdf-84b3-464903e859bf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:36.132397 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1090/2178] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:35 2021] PUT /identity/v3/projects/0af58e5003124f899b7bcefba764df33/users/15ed691bfaa349289f86bd88c315d440/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:36.133707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd220-ff5e-4daa-929c-8d9fe15b2ee0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.134004 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd220-ff5e-4daa-929c-8d9fe15b2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.134493 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dd220-ff5e-4daa-929c-8d9fe15b2ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.152453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1089/2179] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:35 2021] POST /identity/v3/projects => generated 365 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:36.153832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00316560-1e17-445b-8bf7-b1170e7b8ed5 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.154192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00316560-1e17-445b-8bf7-b1170e7b8ed5 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.154423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00316560-1e17-445b-8bf7-b1170e7b8ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.183684 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-010dd220-ff5e-4daa-929c-8d9fe15b2ee0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:36.186070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-010dd220-ff5e-4daa-929c-8d9fe15b2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.230544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-00316560-1e17-445b-8bf7-b1170e7b8ed5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:36.231747 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-00316560-1e17-445b-8bf7-b1170e7b8ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.315720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1090/2180] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:36.316591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00316560-1e17-445b-8bf7-b1170e7b8ed5 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:36.319195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-00316560-1e17-445b-8bf7-b1170e7b8ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.339585 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00316560-1e17-445b-8bf7-b1170e7b8ed5 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:36.340941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1091/2181] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:36.342012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd220-ff5e-4daa-929c-8d9fe15b2ee0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:36.358557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289fa1-c5f4-458b-b230-dd038b2a5b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:36.359215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289fa1-c5f4-458b-b230-dd038b2a5b2a admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.359537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289fa1-c5f4-458b-b230-dd038b2a5b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.359825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289fa1-c5f4-458b-b230-dd038b2a5b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.360537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289fa1-c5f4-458b-b230-dd038b2a5b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:36.362551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dd220-ff5e-4daa-929c-8d9fe15b2ee0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:36.374917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d2159-fa03-4522-a28a-6d9a21e7ec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:36.375965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d2159-fa03-4522-a28a-6d9a21e7ec71 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.376461 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d2159-fa03-4522-a28a-6d9a21e7ec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.376998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d2159-fa03-4522-a28a-6d9a21e7ec71 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.377942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d2159-fa03-4522-a28a-6d9a21e7ec71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:36.413842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289fa1-c5f4-458b-b230-dd038b2a5b2a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:36.420182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d2159-fa03-4522-a28a-6d9a21e7ec71 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:36.425302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1091/2182] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:36 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:36.426794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289fa1-c5f4-458b-b230-dd038b2a5b2a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:36.432239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9e289fa1-c5f4-458b-b230-dd038b2a5b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.447085 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289fa1-c5f4-458b-b230-dd038b2a5b2a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:36.452199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:36.453104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.453404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.453700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] PATH_INFO: `/v3/projects/b8e8df4a0e6541e1a95f328f9c326359` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.455110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e8df4a0e6541e1a95f328f9c326359)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:36.465836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1092/2183] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:36 2021] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:36.466642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d2159-fa03-4522-a28a-6d9a21e7ec71 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:36.470406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-dd9d2159-fa03-4522-a28a-6d9a21e7ec71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.488155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:36.596366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e8df4a0e6541e1a95f328f9c326359', 'request_id': 'req-134da33e-3761-4662-a6b8-a8dd5af00c9d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:36.608615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d2159-fa03-4522-a28a-6d9a21e7ec71 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:36.612104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e8df4a0e6541e1a95f328f9c326359', 'request_id': 'req-134da33e-3761-4662-a6b8-a8dd5af00c9d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:36.624419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e8df4a0e6541e1a95f328f9c326359', 'request_id': 'req-134da33e-3761-4662-a6b8-a8dd5af00c9d'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:36.650383 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] The token cache is being invalidate because project b8e8df4a0e6541e1a95f328f9c326359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:36.651987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:36.653271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:36.656416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1092/2184] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:36 2021] DELETE /identity/v3/projects/b8e8df4a0e6541e1a95f328f9c326359 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:36.658952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:36.662479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.719637 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:36.719841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.720023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.720236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.725171 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.867145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134da33e-3761-4662-a6b8-a8dd5af00c9d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:36.877215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:36.878562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.879133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.880016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.881297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:36.881854 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:36.882162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:36.912839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:36.917358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:36.929732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1093/2185] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:36.930259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1093/2186] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:36.930958 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:36.931548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:36.933492 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.935454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:36.948297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6a153-320b-417a-8b0a-ecd7410cd5c6 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:36.949054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247a639-53b3-4d3f-adaa-c2a71c4c5619 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:36.953447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187cae1-0098-4d72-a6b8-527013f2c77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:36.954459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187cae1-0098-4d72-a6b8-527013f2c77a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.955290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187cae1-0098-4d72-a6b8-527013f2c77a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.955888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187cae1-0098-4d72-a6b8-527013f2c77a admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.957026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187cae1-0098-4d72-a6b8-527013f2c77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:36.959795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dca27-9682-41d2-a6ff-74b5931da061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:36.962860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dca27-9682-41d2-a6ff-74b5931da061 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:36.963166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dca27-9682-41d2-a6ff-74b5931da061 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:36.965193 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dca27-9682-41d2-a6ff-74b5931da061 admin admin] PATH_INFO: `/v3/projects/0af58e5003124f899b7bcefba764df33/users/15ed691bfaa349289f86bd88c315d440/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:36.970317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dca27-9682-41d2-a6ff-74b5931da061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af58e5003124f899b7bcefba764df33, user_id=15ed691bfaa349289f86bd88c315d440, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:36.987207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187cae1-0098-4d72-a6b8-527013f2c77a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:37.000117 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1094/2187] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:36 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:37.001416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa5bb8-cb8e-4893-b526-7c5bada73e52 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:37.001716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa5bb8-cb8e-4893-b526-7c5bada73e52 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:37.002005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa5bb8-cb8e-4893-b526-7c5bada73e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:37.030809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-21aa5bb8-cb8e-4893-b526-7c5bada73e52 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:37.032270 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-21aa5bb8-cb8e-4893-b526-7c5bada73e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:37.041875 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dca27-9682-41d2-a6ff-74b5931da061 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:37.048477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1095/2188] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:37.049667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa5bb8-cb8e-4893-b526-7c5bada73e52 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:37.062749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa5bb8-cb8e-4893-b526-7c5bada73e52 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:37.079847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1094/2189] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:36 2021] PUT /identity/v3/projects/0af58e5003124f899b7bcefba764df33/users/15ed691bfaa349289f86bd88c315d440/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:37.079847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dca27-9682-41d2-a6ff-74b5931da061 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:37.162766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78295f62-e906-41c2-9a5d-241ccde97760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:37.163448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78295f62-e906-41c2-9a5d-241ccde97760 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:37.163827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78295f62-e906-41c2-9a5d-241ccde97760 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:37.164120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78295f62-e906-41c2-9a5d-241ccde97760 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:37.164967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78295f62-e906-41c2-9a5d-241ccde97760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:37.223847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78295f62-e906-41c2-9a5d-241ccde97760 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:37.231677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dca27-9682-41d2-a6ff-74b5931da061 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:37.247130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05028ba1-bf2d-485b-9886-cfa9a43a2359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:37.248522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05028ba1-bf2d-485b-9886-cfa9a43a2359 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:37.248943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05028ba1-bf2d-485b-9886-cfa9a43a2359 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:37.249499 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05028ba1-bf2d-485b-9886-cfa9a43a2359 admin admin] PATH_INFO: `/v3/projects/ce075c95bd8d40f8b9f2cc99cada871e/users/a50b1019c4264adfbc794dff7b92253e/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:37.294857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1096/2190] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:37 2021] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:37.299284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd9b89-6b29-434e-9e01-2293a3ddbab9 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:37.299767 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd9b89-6b29-434e-9e01-2293a3ddbab9 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:37.300764 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd9b89-6b29-434e-9e01-2293a3ddbab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:37.305874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05028ba1-bf2d-485b-9886-cfa9a43a2359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce075c95bd8d40f8b9f2cc99cada871e, user_id=a50b1019c4264adfbc794dff7b92253e, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:37.364529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05028ba1-bf2d-485b-9886-cfa9a43a2359 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:37.372228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-afdd9b89-6b29-434e-9e01-2293a3ddbab9 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:37.374111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-afdd9b89-6b29-434e-9e01-2293a3ddbab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:37.383059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1095/2191] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:37 2021] PUT /identity/v3/projects/ce075c95bd8d40f8b9f2cc99cada871e/users/a50b1019c4264adfbc794dff7b92253e/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:37.383970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05028ba1-bf2d-485b-9886-cfa9a43a2359 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:37.487504 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1097/2192] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:37.491919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd9b89-6b29-434e-9e01-2293a3ddbab9 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:37.503700 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd9b89-6b29-434e-9e01-2293a3ddbab9 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:37.509803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7376f-b097-447a-a3e2-66dac32775d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:37.510554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7376f-b097-447a-a3e2-66dac32775d3 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:37.511033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7376f-b097-447a-a3e2-66dac32775d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:37.511567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7376f-b097-447a-a3e2-66dac32775d3 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:37.512510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7376f-b097-447a-a3e2-66dac32775d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:37.527600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05028ba1-bf2d-485b-9886-cfa9a43a2359 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:37.538398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbcb84-48fc-45b7-a847-9441225fdbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:37.539154 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbcb84-48fc-45b7-a847-9441225fdbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:37.539450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbcb84-48fc-45b7-a847-9441225fdbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:37.539736 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbcb84-48fc-45b7-a847-9441225fdbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:37.540501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbcb84-48fc-45b7-a847-9441225fdbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:37.546058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7376f-b097-447a-a3e2-66dac32775d3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:37.579717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1098/2193] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:37 2021] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:37.581416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7376f-b097-447a-a3e2-66dac32775d3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:37.584886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c5a7376f-b097-447a-a3e2-66dac32775d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:37.593856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbcb84-48fc-45b7-a847-9441225fdbc5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:37.603273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7376f-b097-447a-a3e2-66dac32775d3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:37.622542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:37.623363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:37.623589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:37.623886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] PATH_INFO: `/v3/projects/076d0906af24471cb4831b6aa7ed91a4` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:37.625988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=076d0906af24471cb4831b6aa7ed91a4)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:37.632318 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1096/2194] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:37 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:37.653133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34faad-e3b9-4185-896f-81b0d593e940 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:37.653133 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34faad-e3b9-4185-896f-81b0d593e940 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:37.653444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34faad-e3b9-4185-896f-81b0d593e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:37.703879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:37.749974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-9b34faad-e3b9-4185-896f-81b0d593e940 None None] MFA Rules not processed for user `a50b1019c4264adfbc794dff7b92253e`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:37.751374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9b34faad-e3b9-4185-896f-81b0d593e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:37.782707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076d0906af24471cb4831b6aa7ed91a4', 'request_id': 'req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:37.811588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076d0906af24471cb4831b6aa7ed91a4', 'request_id': 'req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:37.835591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076d0906af24471cb4831b6aa7ed91a4', 'request_id': 'req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:37.867431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] The token cache is being invalidate because project 076d0906af24471cb4831b6aa7ed91a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:37.867759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:37.868378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:37.874401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1099/2195] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:37 2021] DELETE /identity/v3/projects/076d0906af24471cb4831b6aa7ed91a4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:37.874401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:37.874401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:37.954240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1097/2196] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:37 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:37.955428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34faad-e3b9-4185-896f-81b0d593e940 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:37.958637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-9b34faad-e3b9-4185-896f-81b0d593e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:37.976101 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34faad-e3b9-4185-896f-81b0d593e940 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:38.115124 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944cfb0-0847-4ad3-b1a9-217cb5760bfd admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:38.126976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:38.127590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:38.127881 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:38.128166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:38.128869 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:38.129170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:38.151489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2737e7-85f5-422d-8b55-ba9982694bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:38.152658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2737e7-85f5-422d-8b55-ba9982694bbe admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:38.153176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2737e7-85f5-422d-8b55-ba9982694bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:38.154287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2737e7-85f5-422d-8b55-ba9982694bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:38.155692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2737e7-85f5-422d-8b55-ba9982694bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:38.177420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:38.191193 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2737e7-85f5-422d-8b55-ba9982694bbe admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:38.198078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1100/2197] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:38.199569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:38.202945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:38.219810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1098/2198] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:37 2021] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:38.222002 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211dd9-4c69-40a2-8f39-31826143b329 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:38.222306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211dd9-4c69-40a2-8f39-31826143b329 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:38.222589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211dd9-4c69-40a2-8f39-31826143b329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:38.227670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f480-3b0b-4219-99df-b58c5860e234 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:38.242361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ca53-d87e-4361-b770-eb9998f5ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:38.243238 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ca53-d87e-4361-b770-eb9998f5ae2c admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:38.243651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ca53-d87e-4361-b770-eb9998f5ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:38.243820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ca53-d87e-4361-b770-eb9998f5ae2c admin admin] PATH_INFO: `/v3/projects/0af58e5003124f899b7bcefba764df33/users/15ed691bfaa349289f86bd88c315d440/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:38.248673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2ca53-d87e-4361-b770-eb9998f5ae2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af58e5003124f899b7bcefba764df33, user_id=15ed691bfaa349289f86bd88c315d440, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:38.264308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-5a211dd9-4c69-40a2-8f39-31826143b329 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:38.265666 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5a211dd9-4c69-40a2-8f39-31826143b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:38.276552 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1099/2199] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:38.277535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211dd9-4c69-40a2-8f39-31826143b329 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:38.278905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5a211dd9-4c69-40a2-8f39-31826143b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:38.305324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2ca53-d87e-4361-b770-eb9998f5ae2c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:38.337465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1101/2200] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:38 2021] PUT /identity/v3/projects/0af58e5003124f899b7bcefba764df33/users/15ed691bfaa349289f86bd88c315d440/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:38.338645 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ca53-d87e-4361-b770-eb9998f5ae2c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:38.377967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211dd9-4c69-40a2-8f39-31826143b329 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:38.506488 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ca53-d87e-4361-b770-eb9998f5ae2c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:38.519198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151726a3-fa8a-4f1d-8bf9-d3faac9e2d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:38.519865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151726a3-fa8a-4f1d-8bf9-d3faac9e2d0c admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:38.520165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151726a3-fa8a-4f1d-8bf9-d3faac9e2d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:38.520451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151726a3-fa8a-4f1d-8bf9-d3faac9e2d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:38.521351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151726a3-fa8a-4f1d-8bf9-d3faac9e2d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:38.532968 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28b53e-70a9-4156-a4bc-6be78baf465d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:38.533724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28b53e-70a9-4156-a4bc-6be78baf465d service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:38.534114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28b53e-70a9-4156-a4bc-6be78baf465d service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:38.534501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28b53e-70a9-4156-a4bc-6be78baf465d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:38.569366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151726a3-fa8a-4f1d-8bf9-d3faac9e2d0c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:38.601919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1102/2201] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:38 2021] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:38.602987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151726a3-fa8a-4f1d-8bf9-d3faac9e2d0c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:38.643536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28b53e-70a9-4156-a4bc-6be78baf465d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:38.681849 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28b53e-70a9-4156-a4bc-6be78baf465d service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:38.692467 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1100/2202] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:38 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:38.694488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f343-8373-4f87-9320-4a322aabcbf4 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:38.694888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f343-8373-4f87-9320-4a322aabcbf4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:38.695252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49f343-8373-4f87-9320-4a322aabcbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:38.696685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151726a3-fa8a-4f1d-8bf9-d3faac9e2d0c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:38.702529 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69300-68dd-4ac8-908f-c19546159779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:38.703682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69300-68dd-4ac8-908f-c19546159779 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:38.704115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69300-68dd-4ac8-908f-c19546159779 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:38.704563 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb69300-68dd-4ac8-908f-c19546159779 admin admin] PATH_INFO: `/v3/projects/a50d141f01514c1abe5950fdea0e0eb2/users/92aef99a66734a6a874be0bfa5f7ef5e/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:38.725230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7b49f343-8373-4f87-9320-4a322aabcbf4 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:38.726755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7b49f343-8373-4f87-9320-4a322aabcbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:38.732883 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69300-68dd-4ac8-908f-c19546159779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50d141f01514c1abe5950fdea0e0eb2, user_id=92aef99a66734a6a874be0bfa5f7ef5e, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:38.741277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1101/2203] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:38.746449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d34d67-8f08-4fe7-a228-43e9fa70b5c8 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:38.746892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d34d67-8f08-4fe7-a228-43e9fa70b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:38.747289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d34d67-8f08-4fe7-a228-43e9fa70b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:38.772284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb69300-68dd-4ac8-908f-c19546159779 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:38.828914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1103/2204] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:38 2021] PUT /identity/v3/projects/a50d141f01514c1abe5950fdea0e0eb2/users/92aef99a66734a6a874be0bfa5f7ef5e/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:38.830135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69300-68dd-4ac8-908f-c19546159779 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:38.856952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-a1d34d67-8f08-4fe7-a228-43e9fa70b5c8 None None] MFA Rules not processed for user `15ed691bfaa349289f86bd88c315d440`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:38.858166 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a1d34d67-8f08-4fe7-a228-43e9fa70b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:38.966804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1102/2205] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:38 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:38.967846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d34d67-8f08-4fe7-a228-43e9fa70b5c8 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:39.034455 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb69300-68dd-4ac8-908f-c19546159779 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:39.052718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e0127-2777-4964-bbb8-32bd44762d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:39.055640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0127-2777-4964-bbb8-32bd44762d1e admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.056025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0127-2777-4964-bbb8-32bd44762d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.056132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0127-2777-4964-bbb8-32bd44762d1e admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.058197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e0127-2777-4964-bbb8-32bd44762d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:39.126537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d34d67-8f08-4fe7-a228-43e9fa70b5c8 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:39.133031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e0127-2777-4964-bbb8-32bd44762d1e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:39.143475 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:39.144269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.145922 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.146251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.147221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:39.147331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:39.213692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:39.224761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1104/2206] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:38 2021] POST /identity/v3/users => generated 293 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:39.224761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449e28-28d1-40e1-a4f1-ca4a5d4e363f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.224761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449e28-28d1-40e1-a4f1-ca4a5d4e363f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.224761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449e28-28d1-40e1-a4f1-ca4a5d4e363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.229918 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1103/2207] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:39.231974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:39.233529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:39.290968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-06449e28-28d1-40e1-a4f1-ca4a5d4e363f None None] MFA Rules not processed for user `92aef99a66734a6a874be0bfa5f7ef5e`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:39.293178 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-06449e28-28d1-40e1-a4f1-ca4a5d4e363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:39.335725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceef5e5-e186-4639-9128-840a8c2cb41c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:39.340179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eeae08-171c-44de-b91f-7b9faa587afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:39.341361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eeae08-171c-44de-b91f-7b9faa587afd service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.341761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eeae08-171c-44de-b91f-7b9faa587afd service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.342159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eeae08-171c-44de-b91f-7b9faa587afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.345452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-28eeae08-171c-44de-b91f-7b9faa587afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:39.401859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1105/2208] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:39 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:39.402837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449e28-28d1-40e1-a4f1-ca4a5d4e363f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:39.417324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449e28-28d1-40e1-a4f1-ca4a5d4e363f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:39.422601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3567a1-2179-4688-87c2-a25643738bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:39.423743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3567a1-2179-4688-87c2-a25643738bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.423743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3567a1-2179-4688-87c2-a25643738bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.423956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3567a1-2179-4688-87c2-a25643738bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.424618 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3567a1-2179-4688-87c2-a25643738bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:39.429239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eeae08-171c-44de-b91f-7b9faa587afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:39.467300 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3567a1-2179-4688-87c2-a25643738bd8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:39.476378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eeae08-171c-44de-b91f-7b9faa587afd service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:39.479652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1106/2209] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:39 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:39.479652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3567a1-2179-4688-87c2-a25643738bd8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:39.487449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1104/2210] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:39 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:39.488108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eeae08-171c-44de-b91f-7b9faa587afd service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:39.497047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eeae08-171c-44de-b91f-7b9faa587afd service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:39.500984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656705c-a118-4f57-b86b-eca500451a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:39.502287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656705c-a118-4f57-b86b-eca500451a07 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.502718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656705c-a118-4f57-b86b-eca500451a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.503109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656705c-a118-4f57-b86b-eca500451a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.504028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3567a1-2179-4688-87c2-a25643738bd8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:39.515862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd8128-ecb0-4adc-84fb-728c08ebdd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:39.516692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656705c-a118-4f57-b86b-eca500451a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:39.518437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd8128-ecb0-4adc-84fb-728c08ebdd81 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.518788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd8128-ecb0-4adc-84fb-728c08ebdd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.519152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd8128-ecb0-4adc-84fb-728c08ebdd81 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.520337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd8128-ecb0-4adc-84fb-728c08ebdd81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:39.555750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656705c-a118-4f57-b86b-eca500451a07 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:39.571299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1105/2211] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:39 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:39.572188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656705c-a118-4f57-b86b-eca500451a07 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:39.586940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656705c-a118-4f57-b86b-eca500451a07 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:39.591519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78a5ef-9076-4df7-a717-432235a0413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:39.592423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a5ef-9076-4df7-a717-432235a0413e admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.592717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a5ef-9076-4df7-a717-432235a0413e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.593010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a5ef-9076-4df7-a717-432235a0413e admin admin] PATH_INFO: `/v3/projects/cf3310b4e33b4d0cb3757b6fa35787a7/users/bf5a5a8227ef458b9cbd0386c568b7c7/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.609867 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd8128-ecb0-4adc-84fb-728c08ebdd81 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:39.631821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78a5ef-9076-4df7-a717-432235a0413e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3310b4e33b4d0cb3757b6fa35787a7, user_id=bf5a5a8227ef458b9cbd0386c568b7c7, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:39.692945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1107/2212] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:39 2021] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:39.697430 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd8128-ecb0-4adc-84fb-728c08ebdd81 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:39.709164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78a5ef-9076-4df7-a717-432235a0413e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:39.730957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1106/2213] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:39 2021] PUT /identity/v3/projects/cf3310b4e33b4d0cb3757b6fa35787a7/users/bf5a5a8227ef458b9cbd0386c568b7c7/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:39.744422 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ab3f6-3caa-4ccf-b337-d34c57f187ce None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.747466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ab3f6-3caa-4ccf-b337-d34c57f187ce None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.747806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ab3f6-3caa-4ccf-b337-d34c57f187ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.839023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd8128-ecb0-4adc-84fb-728c08ebdd81 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:39.849569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-341ab3f6-3caa-4ccf-b337-d34c57f187ce None None] MFA Rules not processed for user `bf5a5a8227ef458b9cbd0386c568b7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:39.850851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-341ab3f6-3caa-4ccf-b337-d34c57f187ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:39.985772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50875d0-a12b-4262-a511-7677cd1568aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:39.986683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50875d0-a12b-4262-a511-7677cd1568aa admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:39.986983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50875d0-a12b-4262-a511-7677cd1568aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:39.987268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50875d0-a12b-4262-a511-7677cd1568aa admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:39.987913 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50875d0-a12b-4262-a511-7677cd1568aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:40.041383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50875d0-a12b-4262-a511-7677cd1568aa admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:40.069006 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1107/2214] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:39 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:40.074177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ab3f6-3caa-4ccf-b337-d34c57f187ce None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:40.101168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1108/2215] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:39 2021] POST /identity/v3/users => generated 293 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:40.102108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50875d0-a12b-4262-a511-7677cd1568aa admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:40.104575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ab3f6-3caa-4ccf-b337-d34c57f187ce None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:40.126752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368306da-05c1-43dc-8270-1317fee43785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:40.127461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368306da-05c1-43dc-8270-1317fee43785 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.127896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368306da-05c1-43dc-8270-1317fee43785 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.128754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368306da-05c1-43dc-8270-1317fee43785 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.129522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368306da-05c1-43dc-8270-1317fee43785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:40.132755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50875d0-a12b-4262-a511-7677cd1568aa admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:40.155905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870d4c-651f-4ebc-96ec-cd934cf35d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:40.156519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870d4c-651f-4ebc-96ec-cd934cf35d75 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.156826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870d4c-651f-4ebc-96ec-cd934cf35d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.157101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870d4c-651f-4ebc-96ec-cd934cf35d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.157808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c870d4c-651f-4ebc-96ec-cd934cf35d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:40.203329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368306da-05c1-43dc-8270-1317fee43785 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:40.240563 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c870d4c-651f-4ebc-96ec-cd934cf35d75 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:40.269184 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1109/2216] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:40.270652 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870d4c-651f-4ebc-96ec-cd934cf35d75 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:40.281834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1108/2217] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:40 2021] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:40.284907 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368306da-05c1-43dc-8270-1317fee43785 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:40.292594 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870d4c-651f-4ebc-96ec-cd934cf35d75 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:40.412426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368306da-05c1-43dc-8270-1317fee43785 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:40.417862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de05c2-5f2e-46d2-9110-2c301577c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:40.418481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de05c2-5f2e-46d2-9110-2c301577c501 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.419330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de05c2-5f2e-46d2-9110-2c301577c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.419709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de05c2-5f2e-46d2-9110-2c301577c501 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.420425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de05c2-5f2e-46d2-9110-2c301577c501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:40.440909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a38572-e2e9-4ee7-8408-bf04bee5381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:40.448316 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a38572-e2e9-4ee7-8408-bf04bee5381d admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.448738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a38572-e2e9-4ee7-8408-bf04bee5381d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.449508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a38572-e2e9-4ee7-8408-bf04bee5381d admin admin] PATH_INFO: `/v3/projects/17464c5131664d84a88aee4a92d27614/users/0f58edc0163044bc85bed3e29e1fdd01/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.466066 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de05c2-5f2e-46d2-9110-2c301577c501 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:40.494657 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1109/2218] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:40 2021] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:40.495657 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de05c2-5f2e-46d2-9110-2c301577c501 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:40.498862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a38572-e2e9-4ee7-8408-bf04bee5381d admin admin] RBAC: Authorizing `identity:create_grant(project_id=17464c5131664d84a88aee4a92d27614, user_id=0f58edc0163044bc85bed3e29e1fdd01, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:40.516214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de05c2-5f2e-46d2-9110-2c301577c501 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:40.524230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c90d8-7d9c-49c0-b336-175c9757869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:40.524938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c90d8-7d9c-49c0-b336-175c9757869c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.525294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c90d8-7d9c-49c0-b336-175c9757869c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.525656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c90d8-7d9c-49c0-b336-175c9757869c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.526438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c90d8-7d9c-49c0-b336-175c9757869c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:40.558065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c90d8-7d9c-49c0-b336-175c9757869c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:40.566361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a38572-e2e9-4ee7-8408-bf04bee5381d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:40.575026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1110/2219] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:40.579684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c90d8-7d9c-49c0-b336-175c9757869c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:40.593720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c90d8-7d9c-49c0-b336-175c9757869c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:40.598317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1110/2220] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:40 2021] PUT /identity/v3/projects/17464c5131664d84a88aee4a92d27614/users/0f58edc0163044bc85bed3e29e1fdd01/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:40.604370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d521f49-5b83-4093-83cb-332aaedd71a2 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.604850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d521f49-5b83-4093-83cb-332aaedd71a2 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.605179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d521f49-5b83-4093-83cb-332aaedd71a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.638065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5d521f49-5b83-4093-83cb-332aaedd71a2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:40.639396 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5d521f49-5b83-4093-83cb-332aaedd71a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:40.685067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44cce3-f4c8-4d48-8f4c-f32afd4481a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:40.686050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44cce3-f4c8-4d48-8f4c-f32afd4481a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.686455 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44cce3-f4c8-4d48-8f4c-f32afd4481a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.686839 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44cce3-f4c8-4d48-8f4c-f32afd4481a1 admin admin] PATH_INFO: `/v3/projects/ac11b36f54c6411791ca537ad46d7a9b/users/ae663261ba234afda0ae9f7e08d4a143/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.712419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44cce3-f4c8-4d48-8f4c-f32afd4481a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac11b36f54c6411791ca537ad46d7a9b, user_id=ae663261ba234afda0ae9f7e08d4a143, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:40.723571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1111/2221] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:40.735864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d521f49-5b83-4093-83cb-332aaedd71a2 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:40.737470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5d521f49-5b83-4093-83cb-332aaedd71a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:40.746299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44cce3-f4c8-4d48-8f4c-f32afd4481a1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:40.768628 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1111/2222] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:40 2021] PUT /identity/v3/projects/ac11b36f54c6411791ca537ad46d7a9b/users/ae663261ba234afda0ae9f7e08d4a143/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:40.770118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44cce3-f4c8-4d48-8f4c-f32afd4481a1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:40.844533 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d521f49-5b83-4093-83cb-332aaedd71a2 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:40.869558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44cce3-f4c8-4d48-8f4c-f32afd4481a1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:40.874951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328d1dc-4c77-4712-801a-ce57741136d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:40.875567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328d1dc-4c77-4712-801a-ce57741136d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.875861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328d1dc-4c77-4712-801a-ce57741136d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.876148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328d1dc-4c77-4712-801a-ce57741136d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.876853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328d1dc-4c77-4712-801a-ce57741136d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:40.909980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328d1dc-4c77-4712-801a-ce57741136d9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:40.921824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6ee16-8112-444b-8a3e-2a8548a5b5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:40.922929 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6ee16-8112-444b-8a3e-2a8548a5b5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.923234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6ee16-8112-444b-8a3e-2a8548a5b5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.923703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6ee16-8112-444b-8a3e-2a8548a5b5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.928137 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1112/2223] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:40.933140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328d1dc-4c77-4712-801a-ce57741136d9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:40.943732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6ee16-8112-444b-8a3e-2a8548a5b5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:40.959643 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328d1dc-4c77-4712-801a-ce57741136d9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:40.969820 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048e125-0c95-4256-ac79-1da339f3d794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:40.970749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048e125-0c95-4256-ac79-1da339f3d794 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:40.971046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048e125-0c95-4256-ac79-1da339f3d794 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:40.971337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048e125-0c95-4256-ac79-1da339f3d794 admin admin] PATH_INFO: `/v3/projects/ac11b36f54c6411791ca537ad46d7a9b/users/ae663261ba234afda0ae9f7e08d4a143/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:40.976469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048e125-0c95-4256-ac79-1da339f3d794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac11b36f54c6411791ca537ad46d7a9b, user_id=ae663261ba234afda0ae9f7e08d4a143, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:41.002323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6ee16-8112-444b-8a3e-2a8548a5b5d0 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:41.028459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048e125-0c95-4256-ac79-1da339f3d794 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:41.038379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1112/2224] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:41.043161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1113/2225] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:40 2021] PUT /identity/v3/projects/ac11b36f54c6411791ca537ad46d7a9b/users/ae663261ba234afda0ae9f7e08d4a143/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:41.044432 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6ee16-8112-444b-8a3e-2a8548a5b5d0 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:41.065858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6ee16-8112-444b-8a3e-2a8548a5b5d0 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:41.226226 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2026c-cf15-474b-af3d-e34bd3c25199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:41.227423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2026c-cf15-474b-af3d-e34bd3c25199 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:41.227892 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2026c-cf15-474b-af3d-e34bd3c25199 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:41.228670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2026c-cf15-474b-af3d-e34bd3c25199 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:41.229692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2026c-cf15-474b-af3d-e34bd3c25199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:41.281005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2026c-cf15-474b-af3d-e34bd3c25199 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:41.317595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1113/2226] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:41 2021] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:13:41.320193 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048e125-0c95-4256-ac79-1da339f3d794 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:41.334685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048e125-0c95-4256-ac79-1da339f3d794 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:41.340578 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ec7ff-1242-4f21-952e-a000208edb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:41.341717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ec7ff-1242-4f21-952e-a000208edb02 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:41.342217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ec7ff-1242-4f21-952e-a000208edb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:41.342754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ec7ff-1242-4f21-952e-a000208edb02 admin admin] PATH_INFO: `/v3/projects/ac11b36f54c6411791ca537ad46d7a9b/users/ae663261ba234afda0ae9f7e08d4a143/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:41.344828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ec7ff-1242-4f21-952e-a000208edb02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac11b36f54c6411791ca537ad46d7a9b, user_id=ae663261ba234afda0ae9f7e08d4a143, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:41.382290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ec7ff-1242-4f21-952e-a000208edb02 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:41.430901 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1114/2227] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:41 2021] PUT /identity/v3/projects/ac11b36f54c6411791ca537ad46d7a9b/users/ae663261ba234afda0ae9f7e08d4a143/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:41.432874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc2e7-cf8c-4531-ac2e-4bfeebb776f7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:41.433500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc2e7-cf8c-4531-ac2e-4bfeebb776f7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:41.433966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc2e7-cf8c-4531-ac2e-4bfeebb776f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:41.543993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6b8dc2e7-cf8c-4531-ac2e-4bfeebb776f7 None None] MFA Rules not processed for user `ae663261ba234afda0ae9f7e08d4a143`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:41.559790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6b8dc2e7-cf8c-4531-ac2e-4bfeebb776f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:41.615298 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50918d1-124e-488f-b5f6-345ee271af97 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:41.616411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50918d1-124e-488f-b5f6-345ee271af97 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:41.616910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50918d1-124e-488f-b5f6-345ee271af97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:41.709439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-c50918d1-124e-488f-b5f6-345ee271af97 None None] MFA Rules not processed for user `d33fa612914a45dca090798991b8dfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:41.711252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c50918d1-124e-488f-b5f6-345ee271af97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:41.850343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1114/2228] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:41 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:41.934237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1115/2229] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:41 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 27 14:13:41.955759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8dc2e7-cf8c-4531-ac2e-4bfeebb776f7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:42.065455 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8dc2e7-cf8c-4531-ac2e-4bfeebb776f7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:42.088611 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b5f3e-7f04-4480-9946-eedb09438b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:42.089228 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b5f3e-7f04-4480-9946-eedb09438b47 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:42.089636 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b5f3e-7f04-4480-9946-eedb09438b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:42.089804 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b5f3e-7f04-4480-9946-eedb09438b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:42.104241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b5f3e-7f04-4480-9946-eedb09438b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:42.146111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b5f3e-7f04-4480-9946-eedb09438b47 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:42.173541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1115/2230] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:41 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:42.310794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50918d1-124e-488f-b5f6-345ee271af97 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:42.458983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50918d1-124e-488f-b5f6-345ee271af97 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:42.473169 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:42.475110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:42.476065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:42.476361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] PATH_INFO: `/v3/users/bf5a5a8227ef458b9cbd0386c568b7c7` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:42.477767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5a5a8227ef458b9cbd0386c568b7c7)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:42.521998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:42.553719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b5f3e-7f04-4480-9946-eedb09438b47 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:42.562671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b5f3e-7f04-4480-9946-eedb09438b47 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:42.573644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:42.574298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:42.574588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:42.575056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:42.577252 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:42.604703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5a5a8227ef458b9cbd0386c568b7c7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:42.660689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5a5a8227ef458b9cbd0386c568b7c7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:42.662040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5a5a8227ef458b9cbd0386c568b7c7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:42.687673 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:42.690040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5a5a8227ef458b9cbd0386c568b7c7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:42.704236 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3eccdf0c-6d25-4c04-8c53-cf0147510093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5a5a8227ef458b9cbd0386c568b7c7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:42.717135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1116/2231] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:42 2021] DELETE /identity/v3/users/bf5a5a8227ef458b9cbd0386c568b7c7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:42.722081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e1ab-5417-41e9-9771-f937a850fc31 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:42.723634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e1ab-5417-41e9-9771-f937a850fc31 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:42.724233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e1ab-5417-41e9-9771-f937a850fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:42.732542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:42.744480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1116/2232] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:42 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:42.836276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-85c5e1ab-5417-41e9-9771-f937a850fc31 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:42.842114 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-85c5e1ab-5417-41e9-9771-f937a850fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:43.049631 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1117/2233] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:43.171729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:43.173638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:43.323950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502a79-e17c-46c8-bdad-32df18f330ba service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:43.445361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815a122-54d6-4ab0-988f-82bd3ab0981a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:43.445977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815a122-54d6-4ab0-988f-82bd3ab0981a service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:43.446270 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815a122-54d6-4ab0-988f-82bd3ab0981a service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:43.446558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815a122-54d6-4ab0-988f-82bd3ab0981a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:43.469836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815a122-54d6-4ab0-988f-82bd3ab0981a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:43.579667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815a122-54d6-4ab0-988f-82bd3ab0981a service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:43.601738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1117/2234] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:44.508646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5e1ab-5417-41e9-9771-f937a850fc31 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:44.510221 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-85c5e1ab-5417-41e9-9771-f937a850fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:44.628258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5e1ab-5417-41e9-9771-f937a850fc31 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:44.633911 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8abace-7e16-471e-a7cd-ee53367b4677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:44.634550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8abace-7e16-471e-a7cd-ee53367b4677 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:44.635390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8abace-7e16-471e-a7cd-ee53367b4677 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:44.635390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8abace-7e16-471e-a7cd-ee53367b4677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:44.637915 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-bf8abace-7e16-471e-a7cd-ee53367b4677 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:44.756528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8abace-7e16-471e-a7cd-ee53367b4677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:44.785959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8abace-7e16-471e-a7cd-ee53367b4677 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:44.797570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1118/2235] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:44 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:44.814812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815a122-54d6-4ab0-988f-82bd3ab0981a service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:44.816213 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5815a122-54d6-4ab0-988f-82bd3ab0981a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:44.841049 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815a122-54d6-4ab0-988f-82bd3ab0981a service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:44.850814 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:44.851638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:44.851934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:44.852222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] PATH_INFO: `/v3/projects/cf3310b4e33b4d0cb3757b6fa35787a7` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:44.855560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3310b4e33b4d0cb3757b6fa35787a7)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:44.907654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:45.044738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3310b4e33b4d0cb3757b6fa35787a7', 'request_id': 'req-19fbc2c9-11dc-4f57-8e91-dd35626230a8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.074654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3310b4e33b4d0cb3757b6fa35787a7', 'request_id': 'req-19fbc2c9-11dc-4f57-8e91-dd35626230a8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.090564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3310b4e33b4d0cb3757b6fa35787a7', 'request_id': 'req-19fbc2c9-11dc-4f57-8e91-dd35626230a8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.123243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] The token cache is being invalidate because project cf3310b4e33b4d0cb3757b6fa35787a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:45.124779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.126922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.135103 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1118/2236] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:44 2021] DELETE /identity/v3/projects/cf3310b4e33b4d0cb3757b6fa35787a7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:45.137231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8abace-7e16-471e-a7cd-ee53367b4677 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:45.162362 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8abace-7e16-471e-a7cd-ee53367b4677 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:45.267498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:45.268335 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:45.268629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:45.268922 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] PATH_INFO: `/v3/users/ae663261ba234afda0ae9f7e08d4a143` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:45.271036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae663261ba234afda0ae9f7e08d4a143)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:45.352943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:45.428971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae663261ba234afda0ae9f7e08d4a143'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.445372 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae663261ba234afda0ae9f7e08d4a143'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.446407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae663261ba234afda0ae9f7e08d4a143'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.459821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae663261ba234afda0ae9f7e08d4a143'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.474986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3e01fa0b-ba6b-4bd3-919b-8c44b9a263f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae663261ba234afda0ae9f7e08d4a143'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:45.501092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1119/2237] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:45 2021] DELETE /identity/v3/users/ae663261ba234afda0ae9f7e08d4a143 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:45.624474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:45.625974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:45.668280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc2c9-11dc-4f57-8e91-dd35626230a8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:45.921122 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:45.923680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:45.924206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:45.924809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] PATH_INFO: `/v3/users/92aef99a66734a6a874be0bfa5f7ef5e` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:45.928306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92aef99a66734a6a874be0bfa5f7ef5e)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:46.012789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:46.216823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92aef99a66734a6a874be0bfa5f7ef5e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:46.254234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92aef99a66734a6a874be0bfa5f7ef5e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:46.254972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92aef99a66734a6a874be0bfa5f7ef5e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:46.272694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92aef99a66734a6a874be0bfa5f7ef5e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:46.286500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92aef99a66734a6a874be0bfa5f7ef5e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:46.298181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1119/2238] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:45 2021] DELETE /identity/v3/users/92aef99a66734a6a874be0bfa5f7ef5e => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:46.304894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332d73-2e1a-4f1e-b1b6-ef258eb82c0a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:46.305348 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332d73-2e1a-4f1e-b1b6-ef258eb82c0a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:46.305545 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332d73-2e1a-4f1e-b1b6-ef258eb82c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:46.621277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-93332d73-2e1a-4f1e-b1b6-ef258eb82c0a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:46.622519 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-93332d73-2e1a-4f1e-b1b6-ef258eb82c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:46.759779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1120/2239] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:46.779842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:46.781361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:46.977874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb803948-1a00-4a43-b36b-783e3c1b9312 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:47.015511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1209e-2532-4cfe-bfe0-6fe680c0e358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:47.021882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1209e-2532-4cfe-bfe0-6fe680c0e358 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:47.022454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1209e-2532-4cfe-bfe0-6fe680c0e358 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:47.022952 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1209e-2532-4cfe-bfe0-6fe680c0e358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:47.058678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1209e-2532-4cfe-bfe0-6fe680c0e358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:47.190567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1209e-2532-4cfe-bfe0-6fe680c0e358 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:47.248077 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1120/2240] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:47.650526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93332d73-2e1a-4f1e-b1b6-ef258eb82c0a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:47.651986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-93332d73-2e1a-4f1e-b1b6-ef258eb82c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:47.686241 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93332d73-2e1a-4f1e-b1b6-ef258eb82c0a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:47.715828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:47.716639 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:47.716925 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:47.717217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] PATH_INFO: `/v3/projects/ac11b36f54c6411791ca537ad46d7a9b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:47.723452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac11b36f54c6411791ca537ad46d7a9b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:47.797703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:47.934478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac11b36f54c6411791ca537ad46d7a9b', 'request_id': 'req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:47.963360 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac11b36f54c6411791ca537ad46d7a9b', 'request_id': 'req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:47.998567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac11b36f54c6411791ca537ad46d7a9b', 'request_id': 'req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:48.028090 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] The token cache is being invalidate because project ac11b36f54c6411791ca537ad46d7a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:48.028378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:48.032017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-9b0b81fb-61cc-4fdb-889a-50bebd4c75ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:48.038217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1121/2241] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:47 2021] DELETE /identity/v3/projects/ac11b36f54c6411791ca537ad46d7a9b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:48.044181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e2791-d651-47ed-a8a2-38f1dd3541ac None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:48.044711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e2791-d651-47ed-a8a2-38f1dd3541ac None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:48.044798 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e2791-d651-47ed-a8a2-38f1dd3541ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:48.091075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-018e2791-d651-47ed-a8a2-38f1dd3541ac None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:48.094497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-018e2791-d651-47ed-a8a2-38f1dd3541ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:48.288066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1121/2242] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:48.295887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b4820-b9e3-4378-be6c-5d1939ec51a2 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:48.296234 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b4820-b9e3-4378-be6c-5d1939ec51a2 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:48.296558 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b4820-b9e3-4378-be6c-5d1939ec51a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:48.336452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-669b4820-b9e3-4378-be6c-5d1939ec51a2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:48.338826 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-669b4820-b9e3-4378-be6c-5d1939ec51a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:48.359785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1122/2243] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:48.361530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e2791-d651-47ed-a8a2-38f1dd3541ac None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:48.375073 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e2791-d651-47ed-a8a2-38f1dd3541ac None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:48.391837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c6b88-71db-4b8f-9361-c4dab945cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:48.392704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c6b88-71db-4b8f-9361-c4dab945cfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:48.393000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c6b88-71db-4b8f-9361-c4dab945cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:48.393286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c6b88-71db-4b8f-9361-c4dab945cfd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:48.394002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c6b88-71db-4b8f-9361-c4dab945cfd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:48.394305 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c6b88-71db-4b8f-9361-c4dab945cfd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:48.462915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c6b88-71db-4b8f-9361-c4dab945cfd3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:48.494656 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1122/2244] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:48.499141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b4820-b9e3-4378-be6c-5d1939ec51a2 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:48.512182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b4820-b9e3-4378-be6c-5d1939ec51a2 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:48.526278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6054-8915-4e1d-a034-d99826daaae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:48.526920 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6054-8915-4e1d-a034-d99826daaae0 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:48.527266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6054-8915-4e1d-a034-d99826daaae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:48.527482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6054-8915-4e1d-a034-d99826daaae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:48.528148 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa6054-8915-4e1d-a034-d99826daaae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:48.580673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa6054-8915-4e1d-a034-d99826daaae0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:48.639779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1123/2245] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:48 2021] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:48.646162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c6b88-71db-4b8f-9361-c4dab945cfd3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:48.681276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c6b88-71db-4b8f-9361-c4dab945cfd3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:48.920616 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb5c38-696d-4cd7-b897-6e9a58d2f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:48.921606 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb5c38-696d-4cd7-b897-6e9a58d2f77c admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:48.922108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb5c38-696d-4cd7-b897-6e9a58d2f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:48.922587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb5c38-696d-4cd7-b897-6e9a58d2f77c admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:48.923651 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb5c38-696d-4cd7-b897-6e9a58d2f77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:49.014866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb5c38-696d-4cd7-b897-6e9a58d2f77c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:49.062186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1123/2246] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:48 2021] POST /identity/v3/users => generated 290 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:49.067528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6054-8915-4e1d-a034-d99826daaae0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:49.083565 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6054-8915-4e1d-a034-d99826daaae0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:49.105606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9307310-7352-44cf-9bc0-915dbe492095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:49.106238 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9307310-7352-44cf-9bc0-915dbe492095 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:49.106529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9307310-7352-44cf-9bc0-915dbe492095 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:49.106838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9307310-7352-44cf-9bc0-915dbe492095 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:49.112595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9307310-7352-44cf-9bc0-915dbe492095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:49.209244 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9307310-7352-44cf-9bc0-915dbe492095 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:49.258801 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1124/2247] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:49 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:49.263165 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb5c38-696d-4cd7-b897-6e9a58d2f77c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:49.281520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb5c38-696d-4cd7-b897-6e9a58d2f77c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:49.287406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deb404-c5a5-4fec-bcf1-86864c21256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:49.289041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deb404-c5a5-4fec-bcf1-86864c21256a admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:49.289750 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deb404-c5a5-4fec-bcf1-86864c21256a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:49.290229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deb404-c5a5-4fec-bcf1-86864c21256a admin admin] PATH_INFO: `/v3/projects/45dc9773fef44345a6ca53eaffc6fd07/users/a70383f1492b46338ff3f510c9db472a/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:49.335596 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deb404-c5a5-4fec-bcf1-86864c21256a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dc9773fef44345a6ca53eaffc6fd07, user_id=a70383f1492b46338ff3f510c9db472a, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:49.386681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deb404-c5a5-4fec-bcf1-86864c21256a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:49.417455 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1124/2248] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:49 2021] PUT /identity/v3/projects/45dc9773fef44345a6ca53eaffc6fd07/users/a70383f1492b46338ff3f510c9db472a/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:49.430605 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268a1be-2d6e-44f8-8cab-75892df91dcd None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:49.430927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268a1be-2d6e-44f8-8cab-75892df91dcd None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:49.431213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268a1be-2d6e-44f8-8cab-75892df91dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:49.518899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6268a1be-2d6e-44f8-8cab-75892df91dcd None None] MFA Rules not processed for user `a70383f1492b46338ff3f510c9db472a`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:49.522155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6268a1be-2d6e-44f8-8cab-75892df91dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:49.700324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1125/2249] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:49 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:49.701267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deb404-c5a5-4fec-bcf1-86864c21256a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:49.946857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deb404-c5a5-4fec-bcf1-86864c21256a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:49.970466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe0438-2571-4e3f-9451-45fa497ab5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:49.972961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0438-2571-4e3f-9451-45fa497ab5bf admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:49.974056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0438-2571-4e3f-9451-45fa497ab5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:49.974808 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0438-2571-4e3f-9451-45fa497ab5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:49.978547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe0438-2571-4e3f-9451-45fa497ab5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:50.057469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe0438-2571-4e3f-9451-45fa497ab5bf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:50.132241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1125/2250] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:49 2021] POST /identity/v3/projects => generated 379 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:50.136115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268a1be-2d6e-44f8-8cab-75892df91dcd None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:50.152962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268a1be-2d6e-44f8-8cab-75892df91dcd None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:50.285468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aec80f-d28f-47ae-9e0b-05257697ee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:50.287421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aec80f-d28f-47ae-9e0b-05257697ee25 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:50.287899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aec80f-d28f-47ae-9e0b-05257697ee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:50.288394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aec80f-d28f-47ae-9e0b-05257697ee25 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:50.289316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aec80f-d28f-47ae-9e0b-05257697ee25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:50.323340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aec80f-d28f-47ae-9e0b-05257697ee25 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:50.358780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1126/2251] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:50 2021] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:13:50.365395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe0438-2571-4e3f-9451-45fa497ab5bf admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:50.377111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe0438-2571-4e3f-9451-45fa497ab5bf admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:50.384958 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ab123-f066-4c57-a513-39749bf41ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:50.385718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ab123-f066-4c57-a513-39749bf41ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:50.386037 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ab123-f066-4c57-a513-39749bf41ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:50.386320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ab123-f066-4c57-a513-39749bf41ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:50.387063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ab123-f066-4c57-a513-39749bf41ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:50.420130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ab123-f066-4c57-a513-39749bf41ff7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:50.576623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1126/2252] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:50 2021] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:50.580860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aec80f-d28f-47ae-9e0b-05257697ee25 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:50.593566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aec80f-d28f-47ae-9e0b-05257697ee25 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:50.602526 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec036344-2b67-4967-93de-57306474b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:50.603541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec036344-2b67-4967-93de-57306474b767 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:50.603917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec036344-2b67-4967-93de-57306474b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:50.604198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec036344-2b67-4967-93de-57306474b767 admin admin] PATH_INFO: `/v3/projects/93095490221147ff8fdee03657d4772d/users/a2a734163a624f6b96b0af5127ffcf90/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:50.647667 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec036344-2b67-4967-93de-57306474b767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93095490221147ff8fdee03657d4772d, user_id=a2a734163a624f6b96b0af5127ffcf90, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:50.700536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec036344-2b67-4967-93de-57306474b767 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:50.738928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1127/2253] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:50 2021] PUT /identity/v3/projects/93095490221147ff8fdee03657d4772d/users/a2a734163a624f6b96b0af5127ffcf90/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:50.742815 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ab123-f066-4c57-a513-39749bf41ff7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:50.748899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec036344-2b67-4967-93de-57306474b767 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:50.753445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ec036344-2b67-4967-93de-57306474b767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:50.768282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ab123-f066-4c57-a513-39749bf41ff7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:50.908461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec036344-2b67-4967-93de-57306474b767 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:50.924708 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:50.930175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:50.930472 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:50.930790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] PATH_INFO: `/v3/projects/a50d141f01514c1abe5950fdea0e0eb2` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:50.933650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50d141f01514c1abe5950fdea0e0eb2)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:50.935752 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afc781-94d2-4555-86a1-e99de55af222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:50.936371 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc781-94d2-4555-86a1-e99de55af222 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:50.936678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc781-94d2-4555-86a1-e99de55af222 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:50.936938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afc781-94d2-4555-86a1-e99de55af222 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:50.939835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afc781-94d2-4555-86a1-e99de55af222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:50.978765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:50.982199 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afc781-94d2-4555-86a1-e99de55af222 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:51.001982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1127/2254] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:50 2021] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:51.003274 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afc781-94d2-4555-86a1-e99de55af222 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:51.015615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afc781-94d2-4555-86a1-e99de55af222 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:51.020805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9e315-b9b8-48ae-8cec-f95f57ab0364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:51.021968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9e315-b9b8-48ae-8cec-f95f57ab0364 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.022359 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9e315-b9b8-48ae-8cec-f95f57ab0364 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.022778 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9e315-b9b8-48ae-8cec-f95f57ab0364 admin admin] PATH_INFO: `/v3/projects/93095490221147ff8fdee03657d4772d/users/a2a734163a624f6b96b0af5127ffcf90/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.025150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9e315-b9b8-48ae-8cec-f95f57ab0364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93095490221147ff8fdee03657d4772d, user_id=a2a734163a624f6b96b0af5127ffcf90, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:51.102045 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9e315-b9b8-48ae-8cec-f95f57ab0364 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:51.102534 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50d141f01514c1abe5950fdea0e0eb2', 'request_id': 'req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.121800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50d141f01514c1abe5950fdea0e0eb2', 'request_id': 'req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.135694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1128/2255] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:51 2021] PUT /identity/v3/projects/93095490221147ff8fdee03657d4772d/users/a2a734163a624f6b96b0af5127ffcf90/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:51.137182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9e315-b9b8-48ae-8cec-f95f57ab0364 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:51.138003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50d141f01514c1abe5950fdea0e0eb2', 'request_id': 'req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.151751 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] The token cache is being invalidate because project a50d141f01514c1abe5950fdea0e0eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:51.151949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.152607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-0d5477de-2bba-48d1-b9a7-2aa23ae75b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.158887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1128/2256] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:50 2021] DELETE /identity/v3/projects/a50d141f01514c1abe5950fdea0e0eb2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:51.161806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d9284-8034-441f-929b-8d985433bf30 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.161806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d9284-8034-441f-929b-8d985433bf30 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.162053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d9284-8034-441f-929b-8d985433bf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.188725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-484d9284-8034-441f-929b-8d985433bf30 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:51.189927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-484d9284-8034-441f-929b-8d985433bf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:51.277222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9e315-b9b8-48ae-8cec-f95f57ab0364 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:51.288719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758249b-62d1-4033-995a-609b09a19606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:51.289543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758249b-62d1-4033-995a-609b09a19606 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.289982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758249b-62d1-4033-995a-609b09a19606 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.290468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758249b-62d1-4033-995a-609b09a19606 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.291601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758249b-62d1-4033-995a-609b09a19606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:51.293625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1129/2257] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:51.300328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948e694-4fb7-4d67-8ec0-d7f68c2d24f0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.301218 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948e694-4fb7-4d67-8ec0-d7f68c2d24f0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.301589 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948e694-4fb7-4d67-8ec0-d7f68c2d24f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.327439 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758249b-62d1-4033-995a-609b09a19606 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:51.333641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8948e694-4fb7-4d67-8ec0-d7f68c2d24f0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:51.334844 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8948e694-4fb7-4d67-8ec0-d7f68c2d24f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:51.342706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1129/2258] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:13:51.342988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1130/2259] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:51.344023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758249b-62d1-4033-995a-609b09a19606 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:51.345963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6758249b-62d1-4033-995a-609b09a19606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:51.347288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948e694-4fb7-4d67-8ec0-d7f68c2d24f0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:51.359046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948e694-4fb7-4d67-8ec0-d7f68c2d24f0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:51.360260 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758249b-62d1-4033-995a-609b09a19606 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:51.366856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:51.367382 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:51.367683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.367975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.368259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] PATH_INFO: `/v3/users/3632ab392d4044f9ac15559560f8b082` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.368629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.369057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.369450 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3632ab392d4044f9ac15559560f8b082)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:51.369882 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.370764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:51.371931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:51.398923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:51.404129 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:51.419780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1131/2260] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:51.420892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:51.427282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:51.440315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e6cb2-488d-496e-ae24-bf57c2318be2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:51.446293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc8678-b2d7-4339-8f0f-b09a7845e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:51.447446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc8678-b2d7-4339-8f0f-b09a7845e3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.447983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc8678-b2d7-4339-8f0f-b09a7845e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.448480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc8678-b2d7-4339-8f0f-b09a7845e3ad admin admin] PATH_INFO: `/v3/projects/93095490221147ff8fdee03657d4772d/users/a2a734163a624f6b96b0af5127ffcf90/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.450952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc8678-b2d7-4339-8f0f-b09a7845e3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=93095490221147ff8fdee03657d4772d, user_id=a2a734163a624f6b96b0af5127ffcf90, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:51.470043 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3632ab392d4044f9ac15559560f8b082'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.479654 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc8678-b2d7-4339-8f0f-b09a7845e3ad admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:51.494997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3632ab392d4044f9ac15559560f8b082'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.496802 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3632ab392d4044f9ac15559560f8b082'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.502703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1132/2261] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:51 2021] PUT /identity/v3/projects/93095490221147ff8fdee03657d4772d/users/a2a734163a624f6b96b0af5127ffcf90/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:51.505219 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc8678-b2d7-4339-8f0f-b09a7845e3ad admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:51.516102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3632ab392d4044f9ac15559560f8b082'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.528222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64eba6b3-9b79-4cce-b8d9-fe508696fd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3632ab392d4044f9ac15559560f8b082'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:51.541076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1130/2262] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:51 2021] DELETE /identity/v3/users/3632ab392d4044f9ac15559560f8b082 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:51.542983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c09fa-8111-4c65-8324-1caf36d1bb22 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.542983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c09fa-8111-4c65-8324-1caf36d1bb22 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.543287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c09fa-8111-4c65-8324-1caf36d1bb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.584030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a62c09fa-8111-4c65-8324-1caf36d1bb22 None None] MFA Rules not processed for user `a2a734163a624f6b96b0af5127ffcf90`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:51.585221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a62c09fa-8111-4c65-8324-1caf36d1bb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:51.609360 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc8678-b2d7-4339-8f0f-b09a7845e3ad admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:51.674850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1131/2263] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:51 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:51.676541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e8de1-9513-46ca-a196-d39f1790aaae None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.676958 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e8de1-9513-46ca-a196-d39f1790aaae None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.677233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e8de1-9513-46ca-a196-d39f1790aaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.684969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120d8ec-657f-4a1f-9130-68414963c517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:51.685933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120d8ec-657f-4a1f-9130-68414963c517 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.686567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120d8ec-657f-4a1f-9130-68414963c517 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.687051 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120d8ec-657f-4a1f-9130-68414963c517 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.687840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120d8ec-657f-4a1f-9130-68414963c517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:51.705305 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-700e8de1-9513-46ca-a196-d39f1790aaae None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:51.707138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-700e8de1-9513-46ca-a196-d39f1790aaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:51.714834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1132/2264] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:51.714998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e8de1-9513-46ca-a196-d39f1790aaae None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:51.716151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-700e8de1-9513-46ca-a196-d39f1790aaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:51.719271 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120d8ec-657f-4a1f-9130-68414963c517 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:51.757681 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1133/2265] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:51 2021] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:51.759696 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120d8ec-657f-4a1f-9130-68414963c517 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:51.761374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4120d8ec-657f-4a1f-9130-68414963c517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:51.832832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e8de1-9513-46ca-a196-d39f1790aaae None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:51.841056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120d8ec-657f-4a1f-9130-68414963c517 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:51.845790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450f481-84b9-4137-85fe-67c44fa55ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:51.845790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450f481-84b9-4137-85fe-67c44fa55ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.846155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450f481-84b9-4137-85fe-67c44fa55ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.846283 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450f481-84b9-4137-85fe-67c44fa55ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.934759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d90e3-ed16-4b78-b82c-25b8d3c2d3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:51.935414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d90e3-ed16-4b78-b82c-25b8d3c2d3cf service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:51.935705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d90e3-ed16-4b78-b82c-25b8d3c2d3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:51.935989 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d90e3-ed16-4b78-b82c-25b8d3c2d3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:51.956702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450f481-84b9-4137-85fe-67c44fa55ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:51.991373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450f481-84b9-4137-85fe-67c44fa55ef1 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:52.009361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1134/2266] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:52.010793 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450f481-84b9-4137-85fe-67c44fa55ef1 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:52.013314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c450f481-84b9-4137-85fe-67c44fa55ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:52.023639 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d90e3-ed16-4b78-b82c-25b8d3c2d3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:52.028629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450f481-84b9-4137-85fe-67c44fa55ef1 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:52.040923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fa943-06df-4458-ab95-217c5fed50ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:52.043254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa943-06df-4458-ab95-217c5fed50ad admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:52.044580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa943-06df-4458-ab95-217c5fed50ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:52.047024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa943-06df-4458-ab95-217c5fed50ad admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:52.047901 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fa943-06df-4458-ab95-217c5fed50ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:52.072862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d90e3-ed16-4b78-b82c-25b8d3c2d3cf service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:52.087483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1133/2267] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:51 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:52.123053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fa943-06df-4458-ab95-217c5fed50ad admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:52.169296 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1135/2268] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:52 2021] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:52.177806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d90e3-ed16-4b78-b82c-25b8d3c2d3cf service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:52.192293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d90e3-ed16-4b78-b82c-25b8d3c2d3cf service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:52.206469 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924ae30-d4a6-48be-850f-9cb1d8cc457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:52.208079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924ae30-d4a6-48be-850f-9cb1d8cc457a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:52.208593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924ae30-d4a6-48be-850f-9cb1d8cc457a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:52.208735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924ae30-d4a6-48be-850f-9cb1d8cc457a admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:52.209352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924ae30-d4a6-48be-850f-9cb1d8cc457a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:52.264152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924ae30-d4a6-48be-850f-9cb1d8cc457a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:52.291756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1134/2269] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:52 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:52.295732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fa943-06df-4458-ab95-217c5fed50ad admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:52.310980 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fa943-06df-4458-ab95-217c5fed50ad admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:52.317370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09373ebe-ca6e-4452-ac83-19fabc69fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:52.318302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09373ebe-ca6e-4452-ac83-19fabc69fb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:52.318761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09373ebe-ca6e-4452-ac83-19fabc69fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:52.319264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09373ebe-ca6e-4452-ac83-19fabc69fb07 admin admin] PATH_INFO: `/v3/projects/3c4586d1488a46c0a08b21fd62309346/users/973efd5cae004a01bdc62f64dce3c0f5/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:52.355593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09373ebe-ca6e-4452-ac83-19fabc69fb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4586d1488a46c0a08b21fd62309346, user_id=973efd5cae004a01bdc62f64dce3c0f5, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:52.402605 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09373ebe-ca6e-4452-ac83-19fabc69fb07 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:52.419446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1136/2270] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:52 2021] PUT /identity/v3/projects/3c4586d1488a46c0a08b21fd62309346/users/973efd5cae004a01bdc62f64dce3c0f5/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:52.432826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999790e-e020-4d1c-a9d0-8a1751c0154f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:52.433337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999790e-e020-4d1c-a9d0-8a1751c0154f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:52.433862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999790e-e020-4d1c-a9d0-8a1751c0154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:52.514090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5999790e-e020-4d1c-a9d0-8a1751c0154f None None] MFA Rules not processed for user `973efd5cae004a01bdc62f64dce3c0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:52.515420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5999790e-e020-4d1c-a9d0-8a1751c0154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:52.626925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1135/2271] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:52 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:52.632865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09373ebe-ca6e-4452-ac83-19fabc69fb07 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:52.719251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09373ebe-ca6e-4452-ac83-19fabc69fb07 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:52.724399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadc274-74cf-4c66-af43-11b37e5af74a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:52.725378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc274-74cf-4c66-af43-11b37e5af74a service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:52.725378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc274-74cf-4c66-af43-11b37e5af74a service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:52.726195 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc274-74cf-4c66-af43-11b37e5af74a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:52.740207 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadc274-74cf-4c66-af43-11b37e5af74a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:52.777730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadc274-74cf-4c66-af43-11b37e5af74a service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:52.791460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1137/2272] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:52 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:52.811328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999790e-e020-4d1c-a9d0-8a1751c0154f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:52.813247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5999790e-e020-4d1c-a9d0-8a1751c0154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:52.973858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999790e-e020-4d1c-a9d0-8a1751c0154f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:52.979234 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:52.980278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:52.980757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:52.980956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] PATH_INFO: `/v3/projects/87cc677545b340939ea01d49be450645` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:52.982847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cc677545b340939ea01d49be450645)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:53.032709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadc274-74cf-4c66-af43-11b37e5af74a service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:53.034074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fdadc274-74cf-4c66-af43-11b37e5af74a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:53.057438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadc274-74cf-4c66-af43-11b37e5af74a service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:53.059560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:53.064568 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:53.065427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:53.065743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:53.066157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] PATH_INFO: `/v3/users/a70383f1492b46338ff3f510c9db472a` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:53.069460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70383f1492b46338ff3f510c9db472a)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:53.122374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:53.149202 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cc677545b340939ea01d49be450645', 'request_id': 'req-f158d313-9fbc-4983-aba0-4d24c7945148'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.164024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cc677545b340939ea01d49be450645', 'request_id': 'req-f158d313-9fbc-4983-aba0-4d24c7945148'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.174995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cc677545b340939ea01d49be450645', 'request_id': 'req-f158d313-9fbc-4983-aba0-4d24c7945148'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.186925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] The token cache is being invalidate because project 87cc677545b340939ea01d49be450645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:53.187570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.187945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.189484 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1136/2273] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:52 2021] DELETE /identity/v3/projects/87cc677545b340939ea01d49be450645 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:53.195330 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:53.197352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:53.201407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70383f1492b46338ff3f510c9db472a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.218886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70383f1492b46338ff3f510c9db472a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.219960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70383f1492b46338ff3f510c9db472a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.231685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70383f1492b46338ff3f510c9db472a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.241604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-12cdbdb6-2dc5-4c02-90bb-a2de26f7c096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70383f1492b46338ff3f510c9db472a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.251338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1138/2274] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:53 2021] DELETE /identity/v3/users/a70383f1492b46338ff3f510c9db472a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:53.259850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc050385-1545-43b3-92ea-3721952d9649 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:53.260401 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc050385-1545-43b3-92ea-3721952d9649 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:53.260969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc050385-1545-43b3-92ea-3721952d9649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:53.288250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158d313-9fbc-4983-aba0-4d24c7945148 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:53.290750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-dc050385-1545-43b3-92ea-3721952d9649 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:53.291984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-dc050385-1545-43b3-92ea-3721952d9649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:53.366111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:53.367007 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:53.367250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:53.367531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] PATH_INFO: `/v3/users/1a2037c18b0346088c1782e67b4618ca` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:53.368888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2037c18b0346088c1782e67b4618ca)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:53.397153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:53.417655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1139/2275] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:53.431636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc050385-1545-43b3-92ea-3721952d9649 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:53.433495 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-dc050385-1545-43b3-92ea-3721952d9649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:53.503551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2037c18b0346088c1782e67b4618ca'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.532289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2037c18b0346088c1782e67b4618ca'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.533001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2037c18b0346088c1782e67b4618ca'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.548640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2037c18b0346088c1782e67b4618ca'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.552785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc050385-1545-43b3-92ea-3721952d9649 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:53.577698 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:53.578331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:53.578670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:53.578987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:53.584183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-421c6144-30d4-434a-a7ad-a4b03703de3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2037c18b0346088c1782e67b4618ca'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:53.589328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:53.595931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1137/2276] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:53 2021] DELETE /identity/v3/users/1a2037c18b0346088c1782e67b4618ca => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:53.615518 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:53.643878 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:53.668012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1140/2277] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:13:54.923013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6036-9917-436d-bb79-2116bf0e36ad None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:54.923910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6036-9917-436d-bb79-2116bf0e36ad None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:54.924421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6036-9917-436d-bb79-2116bf0e36ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:54.924530 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:54.930347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:54.954093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bf5ec-3fb1-41a1-8467-c80c28c55381 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:55.024605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-74dc6036-9917-436d-bb79-2116bf0e36ad None None] MFA Rules not processed for user `0f58edc0163044bc85bed3e29e1fdd01`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:55.025861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-74dc6036-9917-436d-bb79-2116bf0e36ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:55.094562 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:55.095743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:55.096308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:55.097680 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] PATH_INFO: `/v3/projects/45dc9773fef44345a6ca53eaffc6fd07` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:55.099368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45dc9773fef44345a6ca53eaffc6fd07)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:55.133689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:55.148279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1138/2278] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:54 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:55.149140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6036-9917-436d-bb79-2116bf0e36ad None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:55.150367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-74dc6036-9917-436d-bb79-2116bf0e36ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:55.166222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6036-9917-436d-bb79-2116bf0e36ad None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:55.171542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:55.172531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:55.172908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:55.173193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] PATH_INFO: `/v3/projects/97b0e119d0114eb39e36d3022611f4e1` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:55.174283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b0e119d0114eb39e36d3022611f4e1)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:55.204217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:55.205509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45dc9773fef44345a6ca53eaffc6fd07', 'request_id': 'req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.231311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45dc9773fef44345a6ca53eaffc6fd07', 'request_id': 'req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.255494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45dc9773fef44345a6ca53eaffc6fd07', 'request_id': 'req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.287557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] The token cache is being invalidate because project 45dc9773fef44345a6ca53eaffc6fd07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:55.287899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.288541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.293962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1141/2279] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:54 2021] DELETE /identity/v3/projects/45dc9773fef44345a6ca53eaffc6fd07 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:55.293962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:55.294188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:55.336416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b0e119d0114eb39e36d3022611f4e1', 'request_id': 'req-3625205d-2521-4a4e-8a51-7f07e879b240'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.361580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b0e119d0114eb39e36d3022611f4e1', 'request_id': 'req-3625205d-2521-4a4e-8a51-7f07e879b240'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.370788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b0e119d0114eb39e36d3022611f4e1', 'request_id': 'req-3625205d-2521-4a4e-8a51-7f07e879b240'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.383919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] The token cache is being invalidate because project 97b0e119d0114eb39e36d3022611f4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:55.384200 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.384917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.390427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1139/2280] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:55 2021] DELETE /identity/v3/projects/97b0e119d0114eb39e36d3022611f4e1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:55.391522 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:55.393053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:55.469659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d210273-df44-4cea-a3b5-5b7f6d8e23f7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:55.516403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625205d-2521-4a4e-8a51-7f07e879b240 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:55.536877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:55.538080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:55.538449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:55.539258 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] PATH_INFO: `/v3/users/a2a734163a624f6b96b0af5127ffcf90` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:55.542154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a734163a624f6b96b0af5127ffcf90)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:55.571768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:55.593557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7979-d8c9-4ac9-8129-32d17aa67db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:55.593557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7979-d8c9-4ac9-8129-32d17aa67db8 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:55.593557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7979-d8c9-4ac9-8129-32d17aa67db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:55.593557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7979-d8c9-4ac9-8129-32d17aa67db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:55.594044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7979-d8c9-4ac9-8129-32d17aa67db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:55.627132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7979-d8c9-4ac9-8129-32d17aa67db8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:55.680635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a734163a624f6b96b0af5127ffcf90'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.700211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1142/2281] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:55 2021] POST /identity/v3/projects => generated 385 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:55.700211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7979-d8c9-4ac9-8129-32d17aa67db8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:55.704237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-82bc7979-d8c9-4ac9-8129-32d17aa67db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:55.716894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a734163a624f6b96b0af5127ffcf90'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.718536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a734163a624f6b96b0af5127ffcf90'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.750244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a734163a624f6b96b0af5127ffcf90'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.761886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a734163a624f6b96b0af5127ffcf90'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:55.778432 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1140/2282] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:55 2021] DELETE /identity/v3/users/a2a734163a624f6b96b0af5127ffcf90 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:55.779306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:55.783633 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:55.887898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7979-d8c9-4ac9-8129-32d17aa67db8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:55.933871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473f03c-301f-4788-b4ae-5532d6579fed admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:55.941189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521bbaf-ca66-4a67-990d-982079e1ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:55.942373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521bbaf-ca66-4a67-990d-982079e1ab36 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:55.942743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521bbaf-ca66-4a67-990d-982079e1ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:55.943080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521bbaf-ca66-4a67-990d-982079e1ab36 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:55.943744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521bbaf-ca66-4a67-990d-982079e1ab36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:55.975174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521bbaf-ca66-4a67-990d-982079e1ab36 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:56.001895 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1141/2283] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:55 2021] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:56.007277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521bbaf-ca66-4a67-990d-982079e1ab36 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:56.041991 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521bbaf-ca66-4a67-990d-982079e1ab36 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:56.053810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364afb81-377b-480e-b6a4-6da82ef3b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:56.056928 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364afb81-377b-480e-b6a4-6da82ef3b93d admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:56.057727 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364afb81-377b-480e-b6a4-6da82ef3b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:56.058150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364afb81-377b-480e-b6a4-6da82ef3b93d admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:56.061134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364afb81-377b-480e-b6a4-6da82ef3b93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:56.104713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:56.109363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:56.110979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:56.111191 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364afb81-377b-480e-b6a4-6da82ef3b93d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:56.111848 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] PATH_INFO: `/v3/users/15ed691bfaa349289f86bd88c315d440` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:56.119456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ed691bfaa349289f86bd88c315d440)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:56.125463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1142/2284] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:56 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:56.140147 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364afb81-377b-480e-b6a4-6da82ef3b93d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:56.179931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364afb81-377b-480e-b6a4-6da82ef3b93d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:56.197239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:56.201328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aa90e-d69e-40bc-a2c2-d69491f98e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:56.203185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aa90e-d69e-40bc-a2c2-d69491f98e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:56.203711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aa90e-d69e-40bc-a2c2-d69491f98e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:56.204227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aa90e-d69e-40bc-a2c2-d69491f98e12 admin admin] PATH_INFO: `/v3/projects/1604dadc7e904ed9987e7ded1bc59258/users/c93e6a9d560b44ec8a08f021fe1361fe/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:56.255000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aa90e-d69e-40bc-a2c2-d69491f98e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1604dadc7e904ed9987e7ded1bc59258, user_id=c93e6a9d560b44ec8a08f021fe1361fe, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:56.320956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aa90e-d69e-40bc-a2c2-d69491f98e12 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:56.346529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ed691bfaa349289f86bd88c315d440'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:56.347210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1143/2285] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:56 2021] PUT /identity/v3/projects/1604dadc7e904ed9987e7ded1bc59258/users/c93e6a9d560b44ec8a08f021fe1361fe/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:56.351367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aa90e-d69e-40bc-a2c2-d69491f98e12 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:56.372932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ed691bfaa349289f86bd88c315d440'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:56.379057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ed691bfaa349289f86bd88c315d440'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:56.393726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ed691bfaa349289f86bd88c315d440'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:56.408962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ed691bfaa349289f86bd88c315d440'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:56.423910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1143/2286] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:13:55 2021] DELETE /identity/v3/users/15ed691bfaa349289f86bd88c315d440 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:56.456535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aa90e-d69e-40bc-a2c2-d69491f98e12 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:56.562995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76085e-a8e8-437c-8db0-188649750da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:56.563747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76085e-a8e8-437c-8db0-188649750da0 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:56.564041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76085e-a8e8-437c-8db0-188649750da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:56.564742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76085e-a8e8-437c-8db0-188649750da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:56.565443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76085e-a8e8-437c-8db0-188649750da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:56.594368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76085e-a8e8-437c-8db0-188649750da0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:56.636219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1144/2287] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:56 2021] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:13:56.639156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:56.640676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:56.664424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb029ea-f4ff-4119-bd76-91656f7e5616 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:56.677996 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c43e8f-ff83-46f6-b180-bdb5d486237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:56.678863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c43e8f-ff83-46f6-b180-bdb5d486237a admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:56.679155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c43e8f-ff83-46f6-b180-bdb5d486237a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:56.679440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c43e8f-ff83-46f6-b180-bdb5d486237a admin admin] PATH_INFO: `/v3/projects/1604dadc7e904ed9987e7ded1bc59258/users/c93e6a9d560b44ec8a08f021fe1361fe/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:56.684887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c43e8f-ff83-46f6-b180-bdb5d486237a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1604dadc7e904ed9987e7ded1bc59258, user_id=c93e6a9d560b44ec8a08f021fe1361fe, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:56.741569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c43e8f-ff83-46f6-b180-bdb5d486237a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:56.755536 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1144/2288] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:56 2021] PUT /identity/v3/projects/1604dadc7e904ed9987e7ded1bc59258/users/c93e6a9d560b44ec8a08f021fe1361fe/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:56.760202 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76085e-a8e8-437c-8db0-188649750da0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:56.777443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76085e-a8e8-437c-8db0-188649750da0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:56.930453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1caa45-31dd-498c-b045-89129d7cb07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:56.931110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1caa45-31dd-498c-b045-89129d7cb07b admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:56.931403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1caa45-31dd-498c-b045-89129d7cb07b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:56.931685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1caa45-31dd-498c-b045-89129d7cb07b admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:56.932386 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1caa45-31dd-498c-b045-89129d7cb07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:56.981365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1caa45-31dd-498c-b045-89129d7cb07b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:56.994237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1145/2289] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:56 2021] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:13:56.998149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c43e8f-ff83-46f6-b180-bdb5d486237a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:57.014524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c43e8f-ff83-46f6-b180-bdb5d486237a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:57.025961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076112-7cfb-4f4a-aa44-9a97e5b06e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:57.027038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076112-7cfb-4f4a-aa44-9a97e5b06e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.027539 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076112-7cfb-4f4a-aa44-9a97e5b06e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.027996 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076112-7cfb-4f4a-aa44-9a97e5b06e03 admin admin] PATH_INFO: `/v3/projects/1604dadc7e904ed9987e7ded1bc59258/users/c93e6a9d560b44ec8a08f021fe1361fe/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.030186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b076112-7cfb-4f4a-aa44-9a97e5b06e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1604dadc7e904ed9987e7ded1bc59258, user_id=c93e6a9d560b44ec8a08f021fe1361fe, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:57.106197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b076112-7cfb-4f4a-aa44-9a97e5b06e03 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:57.140471 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1145/2290] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:56 2021] PUT /identity/v3/projects/1604dadc7e904ed9987e7ded1bc59258/users/c93e6a9d560b44ec8a08f021fe1361fe/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:13:57.178413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1caa45-31dd-498c-b045-89129d7cb07b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:57.180116 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8e1caa45-31dd-498c-b045-89129d7cb07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:57.198108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1caa45-31dd-498c-b045-89129d7cb07b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:57.291401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:57.292386 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.292792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.293325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] PATH_INFO: `/v3/projects/0af58e5003124f899b7bcefba764df33` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.295091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af58e5003124f899b7bcefba764df33)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:57.324092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076112-7cfb-4f4a-aa44-9a97e5b06e03 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:57.326032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8b076112-7cfb-4f4a-aa44-9a97e5b06e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:57.343818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:57.370957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076112-7cfb-4f4a-aa44-9a97e5b06e03 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:57.402734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:57.404438 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.406039 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.406866 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] PATH_INFO: `/v3/projects/93095490221147ff8fdee03657d4772d` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.409857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93095490221147ff8fdee03657d4772d)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:57.420779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af58e5003124f899b7bcefba764df33', 'request_id': 'req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.439083 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af58e5003124f899b7bcefba764df33', 'request_id': 'req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.450239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af58e5003124f899b7bcefba764df33', 'request_id': 'req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.451957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:57.466047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] The token cache is being invalidate because project 0af58e5003124f899b7bcefba764df33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:57.466554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.467586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7eb5ede0-0cfc-47d3-a4fb-d9852c56aa80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.470120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1146/2291] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:57 2021] DELETE /identity/v3/projects/0af58e5003124f899b7bcefba764df33 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:57.475637 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd0cfc-882b-4d43-8abe-aabe6346ce24 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.476146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd0cfc-882b-4d43-8abe-aabe6346ce24 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.476592 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd0cfc-882b-4d43-8abe-aabe6346ce24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.523791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ccfd0cfc-882b-4d43-8abe-aabe6346ce24 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:57.524909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ccfd0cfc-882b-4d43-8abe-aabe6346ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:57.555892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93095490221147ff8fdee03657d4772d', 'request_id': 'req-1400f94c-fa09-4fac-9673-8e120ec5c4d0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.582556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93095490221147ff8fdee03657d4772d', 'request_id': 'req-1400f94c-fa09-4fac-9673-8e120ec5c4d0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.599460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93095490221147ff8fdee03657d4772d', 'request_id': 'req-1400f94c-fa09-4fac-9673-8e120ec5c4d0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.619707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] The token cache is being invalidate because project 93095490221147ff8fdee03657d4772d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:13:57.619944 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.622746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-1400f94c-fa09-4fac-9673-8e120ec5c4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:13:57.624750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1146/2292] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:13:57 2021] DELETE /identity/v3/projects/93095490221147ff8fdee03657d4772d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:57.629986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c14b0-d304-4b15-866e-aa49884be86f None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.630294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c14b0-d304-4b15-866e-aa49884be86f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.630583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c14b0-d304-4b15-866e-aa49884be86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.653849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1147/2293] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:57.656362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bac465-9200-4cf5-8e3d-f0919d6b33c2 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.656850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bac465-9200-4cf5-8e3d-f0919d6b33c2 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.656978 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bac465-9200-4cf5-8e3d-f0919d6b33c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.685323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-310c14b0-d304-4b15-866e-aa49884be86f None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:57.686520 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-310c14b0-d304-4b15-866e-aa49884be86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:57.689948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a3bac465-9200-4cf5-8e3d-f0919d6b33c2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:57.691634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a3bac465-9200-4cf5-8e3d-f0919d6b33c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:57.701215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1148/2294] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:57.706499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bac465-9200-4cf5-8e3d-f0919d6b33c2 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:57.715800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1147/2295] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:57.717746 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bac465-9200-4cf5-8e3d-f0919d6b33c2 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:57.717885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a39aca-caa2-476a-8b56-8832069e5406 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.717885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a39aca-caa2-476a-8b56-8832069e5406 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.718186 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a39aca-caa2-476a-8b56-8832069e5406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.724487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1d498-e82b-45bf-acd6-b58eb046eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:57.725364 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1d498-e82b-45bf-acd6-b58eb046eea0 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.725668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1d498-e82b-45bf-acd6-b58eb046eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.725946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1d498-e82b-45bf-acd6-b58eb046eea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.727051 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1d498-e82b-45bf-acd6-b58eb046eea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:57.727351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1d498-e82b-45bf-acd6-b58eb046eea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:57.766038 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-d9a39aca-caa2-476a-8b56-8832069e5406 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:57.768232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d9a39aca-caa2-476a-8b56-8832069e5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:57.781452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1148/2296] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:13:57.788264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a39aca-caa2-476a-8b56-8832069e5406 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:57.807158 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1d498-e82b-45bf-acd6-b58eb046eea0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:57.810857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a39aca-caa2-476a-8b56-8832069e5406 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:57.819690 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b772e-ab4f-4139-bf51-daa799a008e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:57.821796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b772e-ab4f-4139-bf51-daa799a008e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.824070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b772e-ab4f-4139-bf51-daa799a008e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.824489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b772e-ab4f-4139-bf51-daa799a008e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.825255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b772e-ab4f-4139-bf51-daa799a008e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:13:57.826681 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b772e-ab4f-4139-bf51-daa799a008e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:57.838718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1149/2297] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:57.844933 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1d498-e82b-45bf-acd6-b58eb046eea0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:57.868224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1d498-e82b-45bf-acd6-b58eb046eea0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:57.875495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa8e76-0083-471c-9598-d5835b7714e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:57.876362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa8e76-0083-471c-9598-d5835b7714e2 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.878890 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa8e76-0083-471c-9598-d5835b7714e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.879244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa8e76-0083-471c-9598-d5835b7714e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.879963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa8e76-0083-471c-9598-d5835b7714e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:57.898259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b772e-ab4f-4139-bf51-daa799a008e2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:57.945086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1149/2298] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:13:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:13:57.946026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b772e-ab4f-4139-bf51-daa799a008e2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:57.963153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa8e76-0083-471c-9598-d5835b7714e2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:57.967663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b772e-ab4f-4139-bf51-daa799a008e2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:57.981394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75db9c-1088-4e26-84f2-d65bea5c700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:57.982019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75db9c-1088-4e26-84f2-d65bea5c700e admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:57.982311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75db9c-1088-4e26-84f2-d65bea5c700e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:57.982598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75db9c-1088-4e26-84f2-d65bea5c700e admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:57.983697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75db9c-1088-4e26-84f2-d65bea5c700e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:58.037050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1150/2299] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:57 2021] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:58.038683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa8e76-0083-471c-9598-d5835b7714e2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:58.055792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75db9c-1088-4e26-84f2-d65bea5c700e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:58.148457 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1150/2300] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:57 2021] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:58.150230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75db9c-1088-4e26-84f2-d65bea5c700e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:58.225120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa8e76-0083-471c-9598-d5835b7714e2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:58.311072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12dc6a-c848-4fbf-a616-105b56b0f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:58.312069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12dc6a-c848-4fbf-a616-105b56b0f473 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:58.312450 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12dc6a-c848-4fbf-a616-105b56b0f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:58.312956 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12dc6a-c848-4fbf-a616-105b56b0f473 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:58.313856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12dc6a-c848-4fbf-a616-105b56b0f473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:58.344013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75db9c-1088-4e26-84f2-d65bea5c700e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:58.359313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e4212-ccc8-4469-9965-9a752ddd73f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:58.360268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12dc6a-c848-4fbf-a616-105b56b0f473 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:58.360563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4212-ccc8-4469-9965-9a752ddd73f7 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:58.361012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4212-ccc8-4469-9965-9a752ddd73f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:58.361719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4212-ccc8-4469-9965-9a752ddd73f7 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:58.362617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e4212-ccc8-4469-9965-9a752ddd73f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:58.398758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1151/2301] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:58 2021] POST /identity/v3/users => generated 287 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:58.399800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12dc6a-c848-4fbf-a616-105b56b0f473 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:58.410856 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12dc6a-c848-4fbf-a616-105b56b0f473 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:58.415663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8151dae-07a9-4922-90fd-0a637c9d3b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:58.416264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8151dae-07a9-4922-90fd-0a637c9d3b70 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:58.416551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8151dae-07a9-4922-90fd-0a637c9d3b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:58.416893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8151dae-07a9-4922-90fd-0a637c9d3b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:58.417706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8151dae-07a9-4922-90fd-0a637c9d3b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:58.448982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8151dae-07a9-4922-90fd-0a637c9d3b70 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:58.453742 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e4212-ccc8-4469-9965-9a752ddd73f7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:58.470677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1152/2302] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:58.472654 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8151dae-07a9-4922-90fd-0a637c9d3b70 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:58.488436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8151dae-07a9-4922-90fd-0a637c9d3b70 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:58.492620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1151/2303] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:58 2021] POST /identity/v3/users => generated 292 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:58.494377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f950cb-40e6-4b93-899d-7c9f55c33395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:58.495242 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f950cb-40e6-4b93-899d-7c9f55c33395 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:58.495846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f950cb-40e6-4b93-899d-7c9f55c33395 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:58.496129 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f950cb-40e6-4b93-899d-7c9f55c33395 admin admin] PATH_INFO: `/v3/projects/f1bedd96b4a0478daa1b806d41483aaf/users/1fefe832606e4855b0e33a7f7b582925/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:58.500718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e4212-ccc8-4469-9965-9a752ddd73f7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:58.520112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e4212-ccc8-4469-9965-9a752ddd73f7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:58.522360 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f950cb-40e6-4b93-899d-7c9f55c33395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bedd96b4a0478daa1b806d41483aaf, user_id=1fefe832606e4855b0e33a7f7b582925, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:58.540472 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30afb8-cdbc-453a-b6b3-4ae6472d88fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:58.541062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30afb8-cdbc-453a-b6b3-4ae6472d88fb admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:58.541347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30afb8-cdbc-453a-b6b3-4ae6472d88fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:58.541630 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30afb8-cdbc-453a-b6b3-4ae6472d88fb admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:58.542323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30afb8-cdbc-453a-b6b3-4ae6472d88fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:58.564948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f950cb-40e6-4b93-899d-7c9f55c33395 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:58.569866 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30afb8-cdbc-453a-b6b3-4ae6472d88fb admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:58.588305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1152/2304] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:58.594077 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30afb8-cdbc-453a-b6b3-4ae6472d88fb admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:58.594337 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1153/2305] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:58 2021] PUT /identity/v3/projects/f1bedd96b4a0478daa1b806d41483aaf/users/1fefe832606e4855b0e33a7f7b582925/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:58.596378 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdfbdc-628e-43f0-9d59-e36e74b3af7a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:58.601341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdfbdc-628e-43f0-9d59-e36e74b3af7a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:58.601609 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdfbdc-628e-43f0-9d59-e36e74b3af7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:58.608279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30afb8-cdbc-453a-b6b3-4ae6472d88fb admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:58.637793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-1dfdfbdc-628e-43f0-9d59-e36e74b3af7a None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:58.639558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1dfdfbdc-628e-43f0-9d59-e36e74b3af7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:58.702941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682089da-aaab-4e17-94aa-70e00e401d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:58.703866 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682089da-aaab-4e17-94aa-70e00e401d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:58.704184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682089da-aaab-4e17-94aa-70e00e401d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:58.704470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682089da-aaab-4e17-94aa-70e00e401d38 admin admin] PATH_INFO: `/v3/projects/ecfa78a1cbe24c73896a51229a9a111d/users/a95fc9c99c4e4cf68a1bb159d948b04f/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:58.739173 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682089da-aaab-4e17-94aa-70e00e401d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfa78a1cbe24c73896a51229a9a111d, user_id=a95fc9c99c4e4cf68a1bb159d948b04f, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:58.782329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1154/2306] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:58.790440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682089da-aaab-4e17-94aa-70e00e401d38 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:58.792453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdfbdc-628e-43f0-9d59-e36e74b3af7a None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:58.794791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1dfdfbdc-628e-43f0-9d59-e36e74b3af7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:58.811369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1153/2307] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:58 2021] PUT /identity/v3/projects/ecfa78a1cbe24c73896a51229a9a111d/users/a95fc9c99c4e4cf68a1bb159d948b04f/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:58.824508 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21aef-a487-4dad-b824-fb9374c8e34e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:58.825168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21aef-a487-4dad-b824-fb9374c8e34e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:58.825598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e21aef-a487-4dad-b824-fb9374c8e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:58.879752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-52e21aef-a487-4dad-b824-fb9374c8e34e None None] MFA Rules not processed for user `a95fc9c99c4e4cf68a1bb159d948b04f`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:13:58.881215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-52e21aef-a487-4dad-b824-fb9374c8e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:13:58.916148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdfbdc-628e-43f0-9d59-e36e74b3af7a None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:58.974756 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1154/2308] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:13:58 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:13:58.979247 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e21aef-a487-4dad-b824-fb9374c8e34e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:59.014240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1b21-195c-4e21-b670-5e66274a76d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:59.015001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1b21-195c-4e21-b670-5e66274a76d9 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:59.015329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1b21-195c-4e21-b670-5e66274a76d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:59.015659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1b21-195c-4e21-b670-5e66274a76d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:59.129610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e21aef-a487-4dad-b824-fb9374c8e34e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:59.135660 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f4005-22ce-4036-91cf-6f72adaec44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:59.136409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f4005-22ce-4036-91cf-6f72adaec44d admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:59.136954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f4005-22ce-4036-91cf-6f72adaec44d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:59.137474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f4005-22ce-4036-91cf-6f72adaec44d admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:59.138699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f4005-22ce-4036-91cf-6f72adaec44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:59.152257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e1b21-195c-4e21-b670-5e66274a76d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:59.170175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f4005-22ce-4036-91cf-6f72adaec44d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:59.184431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e1b21-195c-4e21-b670-5e66274a76d9 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:59.199880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1155/2309] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:13:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:13:59.214244 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1155/2310] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:13:58 2021] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:59.218008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1b21-195c-4e21-b670-5e66274a76d9 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:59.230492 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1b21-195c-4e21-b670-5e66274a76d9 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:59.337734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83c39-7fd8-4ccf-9605-cf942c7a41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:59.338606 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83c39-7fd8-4ccf-9605-cf942c7a41c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:59.339135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83c39-7fd8-4ccf-9605-cf942c7a41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:59.339516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83c39-7fd8-4ccf-9605-cf942c7a41c7 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:59.342535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb83c39-7fd8-4ccf-9605-cf942c7a41c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:59.386365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb83c39-7fd8-4ccf-9605-cf942c7a41c7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:59.421173 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1156/2311] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:13:59 2021] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:13:59.421780 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f4005-22ce-4036-91cf-6f72adaec44d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:59.435309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f4005-22ce-4036-91cf-6f72adaec44d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:59.446363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1211a-0f6b-4388-af8d-2ab3d650f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:59.447006 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1211a-0f6b-4388-af8d-2ab3d650f876 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:59.447300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1211a-0f6b-4388-af8d-2ab3d650f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:59.447584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1211a-0f6b-4388-af8d-2ab3d650f876 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:59.448288 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1211a-0f6b-4388-af8d-2ab3d650f876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:59.511011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1211a-0f6b-4388-af8d-2ab3d650f876 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:59.529203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1156/2312] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:59 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:13:59.533604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83c39-7fd8-4ccf-9605-cf942c7a41c7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:59.550157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83c39-7fd8-4ccf-9605-cf942c7a41c7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:59.571351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d804e3-f39f-4a5c-b95d-25fb8a318883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:59.573010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d804e3-f39f-4a5c-b95d-25fb8a318883 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:59.574552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d804e3-f39f-4a5c-b95d-25fb8a318883 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:59.575000 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d804e3-f39f-4a5c-b95d-25fb8a318883 admin admin] PATH_INFO: `/v3/projects/c9c61b20e8ad4acf9677266933a7c412/users/a865af2c10da4b5abfaba59616d9f0c0/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:59.612398 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d804e3-f39f-4a5c-b95d-25fb8a318883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c61b20e8ad4acf9677266933a7c412, user_id=a865af2c10da4b5abfaba59616d9f0c0, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:59.681972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d804e3-f39f-4a5c-b95d-25fb8a318883 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:59.710933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1211a-0f6b-4388-af8d-2ab3d650f876 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:59.711618 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1157/2313] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:59 2021] PUT /identity/v3/projects/c9c61b20e8ad4acf9677266933a7c412/users/a865af2c10da4b5abfaba59616d9f0c0/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:13:59.723006 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1211a-0f6b-4388-af8d-2ab3d650f876 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:59.835573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01998b5-5fd6-458e-b7eb-52ab9ec0e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:59.836217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01998b5-5fd6-458e-b7eb-52ab9ec0e372 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:59.836507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01998b5-5fd6-458e-b7eb-52ab9ec0e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:59.836791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01998b5-5fd6-458e-b7eb-52ab9ec0e372 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:59.837487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01998b5-5fd6-458e-b7eb-52ab9ec0e372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:59.866063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01998b5-5fd6-458e-b7eb-52ab9ec0e372 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:13:59.880986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1157/2314] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:13:59 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:13:59.881945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d804e3-f39f-4a5c-b95d-25fb8a318883 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:13:59.902115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d804e3-f39f-4a5c-b95d-25fb8a318883 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:13:59.906796 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c858a-56ab-4f4e-be03-4d3ed1cca841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:13:59.907624 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c858a-56ab-4f4e-be03-4d3ed1cca841 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:13:59.907915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c858a-56ab-4f4e-be03-4d3ed1cca841 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:13:59.908198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c858a-56ab-4f4e-be03-4d3ed1cca841 admin admin] PATH_INFO: `/v3/projects/c9c61b20e8ad4acf9677266933a7c412/users/a865af2c10da4b5abfaba59616d9f0c0/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:13:59.920311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c858a-56ab-4f4e-be03-4d3ed1cca841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c61b20e8ad4acf9677266933a7c412, user_id=a865af2c10da4b5abfaba59616d9f0c0, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:13:59.997572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c858a-56ab-4f4e-be03-4d3ed1cca841 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:00.033584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1158/2315] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:13:59 2021] PUT /identity/v3/projects/c9c61b20e8ad4acf9677266933a7c412/users/a865af2c10da4b5abfaba59616d9f0c0/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:00.035146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01998b5-5fd6-458e-b7eb-52ab9ec0e372 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:00.045431 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01998b5-5fd6-458e-b7eb-52ab9ec0e372 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:00.141855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f83cd0-7c95-41aa-be0e-5d27a5816e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:00.143362 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83cd0-7c95-41aa-be0e-5d27a5816e98 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:00.158050 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83cd0-7c95-41aa-be0e-5d27a5816e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:00.158810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83cd0-7c95-41aa-be0e-5d27a5816e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:00.160009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f83cd0-7c95-41aa-be0e-5d27a5816e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:00.208521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f83cd0-7c95-41aa-be0e-5d27a5816e98 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:00.241546 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c858a-56ab-4f4e-be03-4d3ed1cca841 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:00.248999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1158/2316] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:14:00 2021] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:14:00.260983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c858a-56ab-4f4e-be03-4d3ed1cca841 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:00.265866 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ab73-a078-486d-937c-9b14b458366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:00.266726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ab73-a078-486d-937c-9b14b458366a admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:00.267027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ab73-a078-486d-937c-9b14b458366a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:00.267314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ab73-a078-486d-937c-9b14b458366a admin admin] PATH_INFO: `/v3/projects/c9c61b20e8ad4acf9677266933a7c412/users/a865af2c10da4b5abfaba59616d9f0c0/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:00.269246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273ab73-a078-486d-937c-9b14b458366a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c61b20e8ad4acf9677266933a7c412, user_id=a865af2c10da4b5abfaba59616d9f0c0, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:00.302552 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273ab73-a078-486d-937c-9b14b458366a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:00.329707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1159/2317] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:14:00 2021] PUT /identity/v3/projects/c9c61b20e8ad4acf9677266933a7c412/users/a865af2c10da4b5abfaba59616d9f0c0/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:14:00.335999 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71507-ccf1-4b7f-8508-3a6729695c5e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:00.336301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71507-ccf1-4b7f-8508-3a6729695c5e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:00.336587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71507-ccf1-4b7f-8508-3a6729695c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:00.377500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1dd71507-ccf1-4b7f-8508-3a6729695c5e None None] MFA Rules not processed for user `a865af2c10da4b5abfaba59616d9f0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:00.379673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1dd71507-ccf1-4b7f-8508-3a6729695c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:00.498337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1159/2318] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:00 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:00.509914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ab73-a078-486d-937c-9b14b458366a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:00.511952 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8273ab73-a078-486d-937c-9b14b458366a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:00.614105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ab73-a078-486d-937c-9b14b458366a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:00.619130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d30c2-0dc6-40c8-97bc-6b2613a96039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:00.620016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d30c2-0dc6-40c8-97bc-6b2613a96039 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:00.620402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d30c2-0dc6-40c8-97bc-6b2613a96039 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:00.620797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d30c2-0dc6-40c8-97bc-6b2613a96039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:00.717548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d30c2-0dc6-40c8-97bc-6b2613a96039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:00.751061 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d30c2-0dc6-40c8-97bc-6b2613a96039 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:00.766846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1160/2319] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:00 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:01.033812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a49a9-9748-4b47-ab15-b2f6f5477998 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:01.035228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a49a9-9748-4b47-ab15-b2f6f5477998 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:01.035228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a49a9-9748-4b47-ab15-b2f6f5477998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:01.137014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2b0a49a9-9748-4b47-ab15-b2f6f5477998 None None] MFA Rules not processed for user `1fefe832606e4855b0e33a7f7b582925`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:01.138365 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2b0a49a9-9748-4b47-ab15-b2f6f5477998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:01.346599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1160/2320] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:01 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:01.570530 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d30c2-0dc6-40c8-97bc-6b2613a96039 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:01.571985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ed6d30c2-0dc6-40c8-97bc-6b2613a96039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:01.647272 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d30c2-0dc6-40c8-97bc-6b2613a96039 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:01.651134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f22f9e-ef5b-46e0-9196-3ae4dff70170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:01.651784 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f22f9e-ef5b-46e0-9196-3ae4dff70170 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:01.652079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f22f9e-ef5b-46e0-9196-3ae4dff70170 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:01.652366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f22f9e-ef5b-46e0-9196-3ae4dff70170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:01.668984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f22f9e-ef5b-46e0-9196-3ae4dff70170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:01.735546 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f22f9e-ef5b-46e0-9196-3ae4dff70170 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:01.760131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1161/2321] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:01 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:02.935230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7e80a-71f6-4405-9280-e0411d321dde None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:02.936551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7e80a-71f6-4405-9280-e0411d321dde None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:02.937159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7e80a-71f6-4405-9280-e0411d321dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:02.994582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-5ee7e80a-71f6-4405-9280-e0411d321dde None None] MFA Rules not processed for user `1fefe832606e4855b0e33a7f7b582925`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:02.998161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5ee7e80a-71f6-4405-9280-e0411d321dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:03.065322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1161/2322] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:02 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:08.570251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f22f9e-ef5b-46e0-9196-3ae4dff70170 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:08.582937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f22f9e-ef5b-46e0-9196-3ae4dff70170 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:08.590793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3816d5-6252-4b4b-adf6-69b55aadb4ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:08.591380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3816d5-6252-4b4b-adf6-69b55aadb4ef service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:08.591675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3816d5-6252-4b4b-adf6-69b55aadb4ef service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:08.596002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3816d5-6252-4b4b-adf6-69b55aadb4ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:08.637151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3816d5-6252-4b4b-adf6-69b55aadb4ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:08.686371 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3816d5-6252-4b4b-adf6-69b55aadb4ef service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:08.719050 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1162/2323] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:08 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:10.141792 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7e80a-71f6-4405-9280-e0411d321dde None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:10.146080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5ee7e80a-71f6-4405-9280-e0411d321dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:10.386338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7e80a-71f6-4405-9280-e0411d321dde None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:10.395176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:10.397155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:10.397459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:10.397928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] PATH_INFO: `/v3/users/973efd5cae004a01bdc62f64dce3c0f5` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:10.399739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=973efd5cae004a01bdc62f64dce3c0f5)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:10.449098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:10.552482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973efd5cae004a01bdc62f64dce3c0f5'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:10.571462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973efd5cae004a01bdc62f64dce3c0f5'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:10.575489 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973efd5cae004a01bdc62f64dce3c0f5'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:10.586002 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973efd5cae004a01bdc62f64dce3c0f5'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:10.597568 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973efd5cae004a01bdc62f64dce3c0f5'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:10.610548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1162/2324] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:14:10 2021] DELETE /identity/v3/users/973efd5cae004a01bdc62f64dce3c0f5 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:10.615972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d88fe6-ca14-43d8-a6cb-d506a4025c9c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:10.616502 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d88fe6-ca14-43d8-a6cb-d506a4025c9c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:10.616595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d88fe6-ca14-43d8-a6cb-d506a4025c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:10.697757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b0d88fe6-ca14-43d8-a6cb-d506a4025c9c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:10.701790 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b0d88fe6-ca14-43d8-a6cb-d506a4025c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:10.859011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1163/2325] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:10.875342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:10.876901 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:11.093727 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d96d-78a4-40a8-a174-c3b741d923ba admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:11.098597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459463a9-cb3b-4228-a569-40cdc62f6b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:11.099229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459463a9-cb3b-4228-a569-40cdc62f6b76 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:11.099521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459463a9-cb3b-4228-a569-40cdc62f6b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:11.101313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459463a9-cb3b-4228-a569-40cdc62f6b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:11.114765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459463a9-cb3b-4228-a569-40cdc62f6b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:11.150292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459463a9-cb3b-4228-a569-40cdc62f6b76 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:11.163487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1163/2326] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:11.591306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e7e43-adf0-476b-b625-9197b6d9ede8 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:11.591306 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e7e43-adf0-476b-b625-9197b6d9ede8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:11.591635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e7e43-adf0-476b-b625-9197b6d9ede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:11.636505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-412e7e43-adf0-476b-b625-9197b6d9ede8 None None] MFA Rules not processed for user `c93e6a9d560b44ec8a08f021fe1361fe`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:11.638085 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-412e7e43-adf0-476b-b625-9197b6d9ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:11.721221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1164/2327] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:11 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:11.735791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459463a9-cb3b-4228-a569-40cdc62f6b76 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:11.737621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-459463a9-cb3b-4228-a569-40cdc62f6b76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:11.809332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459463a9-cb3b-4228-a569-40cdc62f6b76 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:11.818696 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5bbc6-e3ac-4982-b67d-1e4bff3424a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ddc229d1a0446c83956f9f0c1ddbfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:11.819465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5bbc6-e3ac-4982-b67d-1e4bff3424a3 service glance] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:11.819760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5bbc6-e3ac-4982-b67d-1e4bff3424a3 service glance] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:11.820046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5bbc6-e3ac-4982-b67d-1e4bff3424a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:11.821762 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-42d5bbc6-e3ac-4982-b67d-1e4bff3424a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:11.925190 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5bbc6-e3ac-4982-b67d-1e4bff3424a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:11.953358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5bbc6-e3ac-4982-b67d-1e4bff3424a3 service glance] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:11.964738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1164/2328] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:11 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:11.979503 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e7e43-adf0-476b-b625-9197b6d9ede8 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:11.982538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-412e7e43-adf0-476b-b625-9197b6d9ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:12.011515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e7e43-adf0-476b-b625-9197b6d9ede8 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:12.029837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:12.031527 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:12.032142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:12.032582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] PATH_INFO: `/v3/projects/3c4586d1488a46c0a08b21fd62309346` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:12.033931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4586d1488a46c0a08b21fd62309346)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:12.083713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:12.189102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ed750-ad3b-43f3-98cf-6a4c5ee1718f None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:12.189102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ed750-ad3b-43f3-98cf-6a4c5ee1718f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:12.189102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ed750-ad3b-43f3-98cf-6a4c5ee1718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:12.203182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4586d1488a46c0a08b21fd62309346', 'request_id': 'req-cacf9709-c96a-4f04-9ed3-31c05bb04d39'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:12.224894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-d77ed750-ad3b-43f3-98cf-6a4c5ee1718f None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:12.225965 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d77ed750-ad3b-43f3-98cf-6a4c5ee1718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:12.226775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4586d1488a46c0a08b21fd62309346', 'request_id': 'req-cacf9709-c96a-4f04-9ed3-31c05bb04d39'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:12.243576 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4586d1488a46c0a08b21fd62309346', 'request_id': 'req-cacf9709-c96a-4f04-9ed3-31c05bb04d39'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:12.274954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] The token cache is being invalidate because project 3c4586d1488a46c0a08b21fd62309346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:14:12.275481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:12.276885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:12.279365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1165/2329] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:14:11 2021] DELETE /identity/v3/projects/3c4586d1488a46c0a08b21fd62309346 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:12.402830 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1165/2330] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:14:12 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:12.409706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:12.411439 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:12.558489 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf9709-c96a-4f04-9ed3-31c05bb04d39 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:12.564699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94686d-b3e0-433d-b6e6-69cc706c784f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:12.565389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94686d-b3e0-433d-b6e6-69cc706c784f service swift] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:12.566317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94686d-b3e0-433d-b6e6-69cc706c784f service swift] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:12.566701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94686d-b3e0-433d-b6e6-69cc706c784f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:12.576975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94686d-b3e0-433d-b6e6-69cc706c784f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:12.608254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94686d-b3e0-433d-b6e6-69cc706c784f service swift] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:12.621879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1166/2331] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:14:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:14:15.255373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ed750-ad3b-43f3-98cf-6a4c5ee1718f None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:15.258289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d77ed750-ad3b-43f3-98cf-6a4c5ee1718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:15.429791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ed750-ad3b-43f3-98cf-6a4c5ee1718f None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:15.436355 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:15.437287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:15.437685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:15.438078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] PATH_INFO: `/v3/users/a95fc9c99c4e4cf68a1bb159d948b04f` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:15.439394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95fc9c99c4e4cf68a1bb159d948b04f)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:15.475394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:15.560141 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95fc9c99c4e4cf68a1bb159d948b04f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:15.574783 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95fc9c99c4e4cf68a1bb159d948b04f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:15.575594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95fc9c99c4e4cf68a1bb159d948b04f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:15.585461 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95fc9c99c4e4cf68a1bb159d948b04f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:15.596306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95fc9c99c4e4cf68a1bb159d948b04f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:15.613807 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1166/2332] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:14:15 2021] DELETE /identity/v3/users/a95fc9c99c4e4cf68a1bb159d948b04f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:15.618975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1563c4-bd99-4d64-9797-6d0011afd9a2 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:15.619548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1563c4-bd99-4d64-9797-6d0011afd9a2 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:15.619773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1563c4-bd99-4d64-9797-6d0011afd9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:15.683607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7b1563c4-bd99-4d64-9797-6d0011afd9a2 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:15.688080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7b1563c4-bd99-4d64-9797-6d0011afd9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:15.803605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1167/2333] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:15.817275 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:15.818862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:15.898516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c817e-87b6-4a92-8e7f-ed0fae7b432b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:15.902342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc634bd9-734a-49d6-bc06-d6f3487e3038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:15.902984 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc634bd9-734a-49d6-bc06-d6f3487e3038 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:15.903274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc634bd9-734a-49d6-bc06-d6f3487e3038 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:15.903557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc634bd9-734a-49d6-bc06-d6f3487e3038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:15.916711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc634bd9-734a-49d6-bc06-d6f3487e3038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:15.946119 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc634bd9-734a-49d6-bc06-d6f3487e3038 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:15.978688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1167/2334] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:16.771717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1563c4-bd99-4d64-9797-6d0011afd9a2 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:16.778800 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7b1563c4-bd99-4d64-9797-6d0011afd9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:16.805836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1563c4-bd99-4d64-9797-6d0011afd9a2 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:16.810687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:16.811598 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:16.811885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:16.812166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] PATH_INFO: `/v3/projects/ecfa78a1cbe24c73896a51229a9a111d` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:16.813439 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecfa78a1cbe24c73896a51229a9a111d)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:16.848623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:16.935019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecfa78a1cbe24c73896a51229a9a111d', 'request_id': 'req-da717b28-7a98-4427-affa-905f04b65dfd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:16.950948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecfa78a1cbe24c73896a51229a9a111d', 'request_id': 'req-da717b28-7a98-4427-affa-905f04b65dfd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:16.964147 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecfa78a1cbe24c73896a51229a9a111d', 'request_id': 'req-da717b28-7a98-4427-affa-905f04b65dfd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:16.991988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] The token cache is being invalidate because project ecfa78a1cbe24c73896a51229a9a111d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:14:16.992279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:16.992898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:16.997346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1168/2335] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:14:16 2021] DELETE /identity/v3/projects/ecfa78a1cbe24c73896a51229a9a111d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:16.998351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc634bd9-734a-49d6-bc06-d6f3487e3038 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:17.015120 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc634bd9-734a-49d6-bc06-d6f3487e3038 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:17.119107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:17.120604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:17.121086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:17.121658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] PATH_INFO: `/v3/users/a865af2c10da4b5abfaba59616d9f0c0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:17.123067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a865af2c10da4b5abfaba59616d9f0c0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:17.152230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:17.227775 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a865af2c10da4b5abfaba59616d9f0c0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:17.241300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a865af2c10da4b5abfaba59616d9f0c0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:17.242065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a865af2c10da4b5abfaba59616d9f0c0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:17.250029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a865af2c10da4b5abfaba59616d9f0c0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:17.260323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-96f9e3c2-01a7-4769-b6bd-6c106e1f989b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a865af2c10da4b5abfaba59616d9f0c0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:17.267390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1168/2336] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:14:16 2021] DELETE /identity/v3/users/a865af2c10da4b5abfaba59616d9f0c0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:17.796499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:17.797983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:17.813742 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da717b28-7a98-4427-affa-905f04b65dfd admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:17.901134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:17.902072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:17.902467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:17.902887 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] PATH_INFO: `/v3/projects/c9c61b20e8ad4acf9677266933a7c412` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:17.904293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c61b20e8ad4acf9677266933a7c412)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:17.935589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:18.034339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c61b20e8ad4acf9677266933a7c412', 'request_id': 'req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:18.051470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c61b20e8ad4acf9677266933a7c412', 'request_id': 'req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:18.067675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c61b20e8ad4acf9677266933a7c412', 'request_id': 'req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:18.082931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] The token cache is being invalidate because project c9c61b20e8ad4acf9677266933a7c412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:14:18.083642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:18.084818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-7d183b30-fb0f-4c48-8860-8c1a55c57b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:18.086884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1169/2337] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:14:17 2021] DELETE /identity/v3/projects/c9c61b20e8ad4acf9677266933a7c412 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:14:18.094448 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005cf3-4123-48ce-aa03-1541a56820ed None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:18.095759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005cf3-4123-48ce-aa03-1541a56820ed None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:18.097409 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005cf3-4123-48ce-aa03-1541a56820ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:18.179825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-51005cf3-4123-48ce-aa03-1541a56820ed None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:18.181131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-51005cf3-4123-48ce-aa03-1541a56820ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:18.288498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1169/2338] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:18.297462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b6447-9d01-473b-850c-d6170ba37910 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:18.298086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b6447-9d01-473b-850c-d6170ba37910 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:18.298615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b6447-9d01-473b-850c-d6170ba37910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:18.344069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-1f3b6447-9d01-473b-850c-d6170ba37910 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:18.345362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1f3b6447-9d01-473b-850c-d6170ba37910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:18.356376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1170/2339] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:18.360300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51005cf3-4123-48ce-aa03-1541a56820ed None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:18.374458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51005cf3-4123-48ce-aa03-1541a56820ed None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:18.384064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b679447-dac0-4fd8-8808-cd41ca1c0f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:18.385040 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679447-dac0-4fd8-8808-cd41ca1c0f25 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:18.385554 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679447-dac0-4fd8-8808-cd41ca1c0f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:18.386082 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679447-dac0-4fd8-8808-cd41ca1c0f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:18.387235 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b679447-dac0-4fd8-8808-cd41ca1c0f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:14:18.387764 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b679447-dac0-4fd8-8808-cd41ca1c0f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:18.416761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b679447-dac0-4fd8-8808-cd41ca1c0f25 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:18.433609 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1170/2340] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:14:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:14:18.443103 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b6447-9d01-473b-850c-d6170ba37910 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:18.453535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b6447-9d01-473b-850c-d6170ba37910 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:18.463323 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe56d0-13d0-4f9d-984a-4901592cc6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:18.463979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe56d0-13d0-4f9d-984a-4901592cc6cf admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:18.464267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe56d0-13d0-4f9d-984a-4901592cc6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:18.464624 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe56d0-13d0-4f9d-984a-4901592cc6cf admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:18.465421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe56d0-13d0-4f9d-984a-4901592cc6cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:18.499269 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe56d0-13d0-4f9d-984a-4901592cc6cf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:18.554183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1171/2341] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:14:18 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:14:18.558664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b679447-dac0-4fd8-8808-cd41ca1c0f25 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:18.569766 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b679447-dac0-4fd8-8808-cd41ca1c0f25 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:18.649020 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad49b5-3684-478a-97ac-62624c0e6ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:18.652201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad49b5-3684-478a-97ac-62624c0e6ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:18.652201 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad49b5-3684-478a-97ac-62624c0e6ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:18.652486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad49b5-3684-478a-97ac-62624c0e6ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:18.652991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad49b5-3684-478a-97ac-62624c0e6ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:18.684140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad49b5-3684-478a-97ac-62624c0e6ca4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:18.710745 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1171/2342] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:14:18 2021] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:14:18.713864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe56d0-13d0-4f9d-984a-4901592cc6cf admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:18.728178 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe56d0-13d0-4f9d-984a-4901592cc6cf admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:18.731966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6d0ad-e7e1-470d-bac7-81ddf9f499cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:18.732872 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d0ad-e7e1-470d-bac7-81ddf9f499cf admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:18.733547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d0ad-e7e1-470d-bac7-81ddf9f499cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:18.733855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d0ad-e7e1-470d-bac7-81ddf9f499cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:18.734733 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6d0ad-e7e1-470d-bac7-81ddf9f499cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:18.770585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6d0ad-e7e1-470d-bac7-81ddf9f499cf admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:18.792279 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1172/2343] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:14:18 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:14:18.793027 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad49b5-3684-478a-97ac-62624c0e6ca4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:18.805202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad49b5-3684-478a-97ac-62624c0e6ca4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:18.809828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a807676-fcb5-4d8d-9253-d311b3f9b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:18.811991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807676-fcb5-4d8d-9253-d311b3f9b50b admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:18.812292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807676-fcb5-4d8d-9253-d311b3f9b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:18.812586 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807676-fcb5-4d8d-9253-d311b3f9b50b admin admin] PATH_INFO: `/v3/projects/f282a659d96c44469a55146e25a82fd0/users/6116cd8b59cb4356bd446707b2d5677c/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:18.857871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a807676-fcb5-4d8d-9253-d311b3f9b50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f282a659d96c44469a55146e25a82fd0, user_id=6116cd8b59cb4356bd446707b2d5677c, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:18.887034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a807676-fcb5-4d8d-9253-d311b3f9b50b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:18.907137 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1172/2344] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:14:18 2021] PUT /identity/v3/projects/f282a659d96c44469a55146e25a82fd0/users/6116cd8b59cb4356bd446707b2d5677c/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:18.921697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9668f-b8fb-446b-88df-e1ae338893a8 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:18.922269 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9668f-b8fb-446b-88df-e1ae338893a8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:18.922269 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9668f-b8fb-446b-88df-e1ae338893a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:18.966849 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-4ca9668f-b8fb-446b-88df-e1ae338893a8 None None] MFA Rules not processed for user `6116cd8b59cb4356bd446707b2d5677c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:18.967940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4ca9668f-b8fb-446b-88df-e1ae338893a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:19.077011 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1173/2345] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:18 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:19.087622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a807676-fcb5-4d8d-9253-d311b3f9b50b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:19.089305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5a807676-fcb5-4d8d-9253-d311b3f9b50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:19.179584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a807676-fcb5-4d8d-9253-d311b3f9b50b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:19.183847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d1963-fbc3-4f82-bcba-e3eae5672da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:19.184633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d1963-fbc3-4f82-bcba-e3eae5672da5 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:19.185217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d1963-fbc3-4f82-bcba-e3eae5672da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:19.185655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d1963-fbc3-4f82-bcba-e3eae5672da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:19.195861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d1963-fbc3-4f82-bcba-e3eae5672da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:19.289568 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d1963-fbc3-4f82-bcba-e3eae5672da5 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:19.327524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1173/2346] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:19 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:25.204536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3a167-e3a7-442c-9ca9-27c727e10949 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:25.205123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3a167-e3a7-442c-9ca9-27c727e10949 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:25.205123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3a167-e3a7-442c-9ca9-27c727e10949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:25.227703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7be3a167-e3a7-442c-9ca9-27c727e10949 None None] MFA Rules not processed for user `0f58edc0163044bc85bed3e29e1fdd01`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:25.228844 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7be3a167-e3a7-442c-9ca9-27c727e10949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:25.291647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1174/2347] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:25 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:27.284551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bcc9-b4be-4723-8130-31ee0ee54806 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:27.285155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bcc9-b4be-4723-8130-31ee0ee54806 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:27.285442 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9bcc9-b4be-4723-8130-31ee0ee54806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:27.312552 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-33d9bcc9-b4be-4723-8130-31ee0ee54806 None None] MFA Rules not processed for user `d33fa612914a45dca090798991b8dfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:27.314308 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-33d9bcc9-b4be-4723-8130-31ee0ee54806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:27.392246 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1174/2348] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:27 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:28.170254 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad80d3f-0a53-4600-8f3b-edbd0eaf52a4 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:28.170830 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad80d3f-0a53-4600-8f3b-edbd0eaf52a4 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:28.171017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad80d3f-0a53-4600-8f3b-edbd0eaf52a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:28.263400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-4ad80d3f-0a53-4600-8f3b-edbd0eaf52a4 None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:28.269264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4ad80d3f-0a53-4600-8f3b-edbd0eaf52a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:28.449998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1175/2349] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:14:28 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:28.477440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9bcc9-b4be-4723-8130-31ee0ee54806 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:28.478873 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-33d9bcc9-b4be-4723-8130-31ee0ee54806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:28.649236 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9bcc9-b4be-4723-8130-31ee0ee54806 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:28.663144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1efa3e-313e-4889-bab1-c5348dc2f942 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:28.664030 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1efa3e-313e-4889-bab1-c5348dc2f942 service swift] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:28.664484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1efa3e-313e-4889-bab1-c5348dc2f942 service swift] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:28.664929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1efa3e-313e-4889-bab1-c5348dc2f942 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:28.701582 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1efa3e-313e-4889-bab1-c5348dc2f942 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:28.749758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1efa3e-313e-4889-bab1-c5348dc2f942 service swift] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:28.773547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1175/2350] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:14:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:14:31.412065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad80d3f-0a53-4600-8f3b-edbd0eaf52a4 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:31.581753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad80d3f-0a53-4600-8f3b-edbd0eaf52a4 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:31.615820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:31.616668 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:31.619296 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:31.619511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] PATH_INFO: `/v3/users/6116cd8b59cb4356bd446707b2d5677c` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:31.624240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6116cd8b59cb4356bd446707b2d5677c)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:31.725055 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:31.943834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6116cd8b59cb4356bd446707b2d5677c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:32.006735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6116cd8b59cb4356bd446707b2d5677c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:32.008095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6116cd8b59cb4356bd446707b2d5677c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:32.069952 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6116cd8b59cb4356bd446707b2d5677c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:32.091101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6116cd8b59cb4356bd446707b2d5677c'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:32.116480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1176/2351] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:14:31 2021] DELETE /identity/v3/users/6116cd8b59cb4356bd446707b2d5677c => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:32.120856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c375e22-6184-4b60-b19e-b7816a4a5289 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:32.121425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c375e22-6184-4b60-b19e-b7816a4a5289 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:32.121425 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c375e22-6184-4b60-b19e-b7816a4a5289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:32.185772 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6c375e22-6184-4b60-b19e-b7816a4a5289 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:32.197607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6c375e22-6184-4b60-b19e-b7816a4a5289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:32.435623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1176/2352] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:32.506660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:32.508688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:32.755671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6dacb7-d405-4d0a-b5b3-c533380dab33 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:32.773312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9f9c2-17ce-472b-95ae-7c55ad61beb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:32.775145 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9f9c2-17ce-472b-95ae-7c55ad61beb3 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:32.776062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9f9c2-17ce-472b-95ae-7c55ad61beb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:32.776920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9f9c2-17ce-472b-95ae-7c55ad61beb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:32.802604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9f9c2-17ce-472b-95ae-7c55ad61beb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:32.887915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9f9c2-17ce-472b-95ae-7c55ad61beb3 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:32.911614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1177/2353] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:33.694233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c375e22-6184-4b60-b19e-b7816a4a5289 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:33.695926 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6c375e22-6184-4b60-b19e-b7816a4a5289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:33.714659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c375e22-6184-4b60-b19e-b7816a4a5289 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:33.719773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:33.720695 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:33.721738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:33.722395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] PATH_INFO: `/v3/projects/f282a659d96c44469a55146e25a82fd0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:33.724078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f282a659d96c44469a55146e25a82fd0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:33.783922 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:33.903433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f282a659d96c44469a55146e25a82fd0', 'request_id': 'req-538d9a5d-8b74-45d0-8be7-e523cb01207a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:33.934701 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f282a659d96c44469a55146e25a82fd0', 'request_id': 'req-538d9a5d-8b74-45d0-8be7-e523cb01207a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:33.948814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f282a659d96c44469a55146e25a82fd0', 'request_id': 'req-538d9a5d-8b74-45d0-8be7-e523cb01207a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:33.975406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] The token cache is being invalidate because project f282a659d96c44469a55146e25a82fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:14:33.976302 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:33.977427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-538d9a5d-8b74-45d0-8be7-e523cb01207a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:33.980466 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1177/2354] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:14:33 2021] DELETE /identity/v3/projects/f282a659d96c44469a55146e25a82fd0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:33.992864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e8e5-efd7-4095-80e0-113be2090ac8 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:33.994069 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e8e5-efd7-4095-80e0-113be2090ac8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:33.994905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e8e5-efd7-4095-80e0-113be2090ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:34.108393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ade6e8e5-efd7-4095-80e0-113be2090ac8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:34.113847 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ade6e8e5-efd7-4095-80e0-113be2090ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:34.270550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1178/2355] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:14:34.274871 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacbf38-7200-40aa-8b59-455c1f2b800c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:34.275228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacbf38-7200-40aa-8b59-455c1f2b800c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:34.276010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacbf38-7200-40aa-8b59-455c1f2b800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:34.328139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-afacbf38-7200-40aa-8b59-455c1f2b800c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:34.329379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-afacbf38-7200-40aa-8b59-455c1f2b800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:34.338819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1178/2356] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:14:34.343259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6e8e5-efd7-4095-80e0-113be2090ac8 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:34.365497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6e8e5-efd7-4095-80e0-113be2090ac8 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:34.370385 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8af71-358c-408b-8e72-1993a8a3d11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:34.371294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8af71-358c-408b-8e72-1993a8a3d11e admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:34.371791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8af71-358c-408b-8e72-1993a8a3d11e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:34.372230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8af71-358c-408b-8e72-1993a8a3d11e admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:34.373121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8af71-358c-408b-8e72-1993a8a3d11e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:14:34.373548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8af71-358c-408b-8e72-1993a8a3d11e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:34.401520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8af71-358c-408b-8e72-1993a8a3d11e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:34.418257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1179/2357] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:14:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:14:34.422524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacbf38-7200-40aa-8b59-455c1f2b800c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:34.432697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacbf38-7200-40aa-8b59-455c1f2b800c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:34.437654 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723fef5-09db-44ed-a531-3a3e86858dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:34.438419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723fef5-09db-44ed-a531-3a3e86858dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:34.438856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723fef5-09db-44ed-a531-3a3e86858dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:34.439270 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723fef5-09db-44ed-a531-3a3e86858dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:34.440344 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723fef5-09db-44ed-a531-3a3e86858dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:34.467091 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723fef5-09db-44ed-a531-3a3e86858dc3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:34.501992 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1179/2358] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:14:34 2021] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:14:34.503431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8af71-358c-408b-8e72-1993a8a3d11e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:34.513949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8af71-358c-408b-8e72-1993a8a3d11e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:34.585441 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397753e5-8328-457d-9969-947eeebdf0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:34.586223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397753e5-8328-457d-9969-947eeebdf0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:34.586664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397753e5-8328-457d-9969-947eeebdf0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:34.587095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397753e5-8328-457d-9969-947eeebdf0b2 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:34.587862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397753e5-8328-457d-9969-947eeebdf0b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:34.623674 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397753e5-8328-457d-9969-947eeebdf0b2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:34.646510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1180/2359] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:14:34 2021] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:14:34.650891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723fef5-09db-44ed-a531-3a3e86858dc3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:34.661312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723fef5-09db-44ed-a531-3a3e86858dc3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:34.665533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8761e57-8b2a-43cc-9cf1-50dfac62a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:34.666226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8761e57-8b2a-43cc-9cf1-50dfac62a253 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:34.666579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8761e57-8b2a-43cc-9cf1-50dfac62a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:34.667034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8761e57-8b2a-43cc-9cf1-50dfac62a253 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:34.667807 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8761e57-8b2a-43cc-9cf1-50dfac62a253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:34.696280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8761e57-8b2a-43cc-9cf1-50dfac62a253 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:34.706987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1180/2360] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:14:34 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:14:34.711486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397753e5-8328-457d-9969-947eeebdf0b2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:34.721857 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397753e5-8328-457d-9969-947eeebdf0b2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:34.726018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da1a12-9661-4afb-9148-f349d4d53c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:34.726859 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1a12-9661-4afb-9148-f349d4d53c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:34.727150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1a12-9661-4afb-9148-f349d4d53c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:34.727432 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1a12-9661-4afb-9148-f349d4d53c84 admin admin] PATH_INFO: `/v3/projects/a65515b5f5df43aea6fd099108a3e961/users/884b2c83926146828276418e0101925f/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:34.748150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da1a12-9661-4afb-9148-f349d4d53c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65515b5f5df43aea6fd099108a3e961, user_id=884b2c83926146828276418e0101925f, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:34.775110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da1a12-9661-4afb-9148-f349d4d53c84 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:34.789795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1181/2361] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:14:34 2021] PUT /identity/v3/projects/a65515b5f5df43aea6fd099108a3e961/users/884b2c83926146828276418e0101925f/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:34.794665 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fa455-f0a1-48bb-80d5-7c25b0a505bf None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:34.795310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fa455-f0a1-48bb-80d5-7c25b0a505bf None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:34.795593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fa455-f0a1-48bb-80d5-7c25b0a505bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:34.829528 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-587fa455-f0a1-48bb-80d5-7c25b0a505bf None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:34.831982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-587fa455-f0a1-48bb-80d5-7c25b0a505bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:34.912625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1181/2362] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:34.922541 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da1a12-9661-4afb-9148-f349d4d53c84 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:34.924709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c2da1a12-9661-4afb-9148-f349d4d53c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:35.058858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da1a12-9661-4afb-9148-f349d4d53c84 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:35.073531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf7111-3e6f-4782-b85a-2ffd7a696dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:35.074179 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf7111-3e6f-4782-b85a-2ffd7a696dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:35.074454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf7111-3e6f-4782-b85a-2ffd7a696dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:35.074765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf7111-3e6f-4782-b85a-2ffd7a696dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:35.096820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf7111-3e6f-4782-b85a-2ffd7a696dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:35.136399 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf7111-3e6f-4782-b85a-2ffd7a696dc9 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:35.157137 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1182/2363] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:36.445449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fa455-f0a1-48bb-80d5-7c25b0a505bf None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:36.446887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-587fa455-f0a1-48bb-80d5-7c25b0a505bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:36.462987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fa455-f0a1-48bb-80d5-7c25b0a505bf None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:36.467777 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:36.468805 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:36.469449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:36.470179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] PATH_INFO: `/v3/users/a50b1019c4264adfbc794dff7b92253e` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:36.479196 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50b1019c4264adfbc794dff7b92253e)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:36.517484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:36.610008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50b1019c4264adfbc794dff7b92253e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:36.625711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50b1019c4264adfbc794dff7b92253e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:36.626431 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50b1019c4264adfbc794dff7b92253e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:36.635857 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50b1019c4264adfbc794dff7b92253e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:36.663293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50b1019c4264adfbc794dff7b92253e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:36.675881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1182/2364] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:14:36 2021] DELETE /identity/v3/users/a50b1019c4264adfbc794dff7b92253e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:36.684500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233704-8f01-464b-b407-cee334207c5b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:36.685603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233704-8f01-464b-b407-cee334207c5b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:36.686181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233704-8f01-464b-b407-cee334207c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:36.718819 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-60233704-8f01-464b-b407-cee334207c5b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:36.720714 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-60233704-8f01-464b-b407-cee334207c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:36.820660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1183/2365] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:36.828479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:36.831065 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:36.977848 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b228057-60e8-417d-819e-a1dd7b62942d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:36.982020 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1a0d-56f5-4c68-9795-a783f146d53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:36.982637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1a0d-56f5-4c68-9795-a783f146d53d service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:36.982953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1a0d-56f5-4c68-9795-a783f146d53d service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:36.983242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1a0d-56f5-4c68-9795-a783f146d53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:37.006680 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1a0d-56f5-4c68-9795-a783f146d53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:37.051601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1a0d-56f5-4c68-9795-a783f146d53d service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:37.103721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1183/2366] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:38.551304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60233704-8f01-464b-b407-cee334207c5b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:38.554370 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-60233704-8f01-464b-b407-cee334207c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:38.579876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60233704-8f01-464b-b407-cee334207c5b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:38.608233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:38.611487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:38.612723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:38.615189 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] PATH_INFO: `/v3/projects/ce075c95bd8d40f8b9f2cc99cada871e` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:38.618695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce075c95bd8d40f8b9f2cc99cada871e)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:38.654718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:38.730826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce075c95bd8d40f8b9f2cc99cada871e', 'request_id': 'req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:38.745253 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce075c95bd8d40f8b9f2cc99cada871e', 'request_id': 'req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:38.756501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce075c95bd8d40f8b9f2cc99cada871e', 'request_id': 'req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:38.774431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] The token cache is being invalidate because project ce075c95bd8d40f8b9f2cc99cada871e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:14:38.775016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:38.775812 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9cdfe924-74ea-43d7-bc46-a75c8ecaf5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:14:38.781791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1184/2367] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:14:38 2021] DELETE /identity/v3/projects/ce075c95bd8d40f8b9f2cc99cada871e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:38.783460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672de17-d2f6-4bd7-a255-2534158594ba None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:38.784014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672de17-d2f6-4bd7-a255-2534158594ba None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:38.784117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672de17-d2f6-4bd7-a255-2534158594ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:38.813942 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-b672de17-d2f6-4bd7-a255-2534158594ba None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:38.815921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b672de17-d2f6-4bd7-a255-2534158594ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:38.948076 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1184/2368] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:14:38.957281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b8a34-e81e-4aae-aaa2-786502272dc5 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:38.958022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b8a34-e81e-4aae-aaa2-786502272dc5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:38.958229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b8a34-e81e-4aae-aaa2-786502272dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:39.023829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-001b8a34-e81e-4aae-aaa2-786502272dc5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:39.025374 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-001b8a34-e81e-4aae-aaa2-786502272dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:39.041914 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1185/2369] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:39.042964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672de17-d2f6-4bd7-a255-2534158594ba None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:39.054595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672de17-d2f6-4bd7-a255-2534158594ba None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:39.066031 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede00b28-34b0-4b52-b8c4-7fe624792ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:39.066896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede00b28-34b0-4b52-b8c4-7fe624792ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:39.067176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede00b28-34b0-4b52-b8c4-7fe624792ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:39.067337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede00b28-34b0-4b52-b8c4-7fe624792ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:39.068046 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede00b28-34b0-4b52-b8c4-7fe624792ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:14:39.068395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede00b28-34b0-4b52-b8c4-7fe624792ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:39.105095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede00b28-34b0-4b52-b8c4-7fe624792ad0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:39.125397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1185/2370] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:14:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:14:39.129966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b8a34-e81e-4aae-aaa2-786502272dc5 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:39.139908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b8a34-e81e-4aae-aaa2-786502272dc5 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:39.146217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7b045-0404-4a1e-ae6f-6fdb6ee3fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:39.146971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7b045-0404-4a1e-ae6f-6fdb6ee3fff7 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:39.147372 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7b045-0404-4a1e-ae6f-6fdb6ee3fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:39.147722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7b045-0404-4a1e-ae6f-6fdb6ee3fff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:39.148437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7b045-0404-4a1e-ae6f-6fdb6ee3fff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:39.178146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7b045-0404-4a1e-ae6f-6fdb6ee3fff7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:39.239062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1186/2371] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:14:39 2021] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:14:39.242842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede00b28-34b0-4b52-b8c4-7fe624792ad0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:39.272746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede00b28-34b0-4b52-b8c4-7fe624792ad0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:39.453182 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e024315-8985-4922-84bf-086bdb85ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:39.454198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e024315-8985-4922-84bf-086bdb85ba12 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:39.455641 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e024315-8985-4922-84bf-086bdb85ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:39.460127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e024315-8985-4922-84bf-086bdb85ba12 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:39.461099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e024315-8985-4922-84bf-086bdb85ba12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:39.536650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e024315-8985-4922-84bf-086bdb85ba12 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:39.600247 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1186/2372] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:14:39 2021] POST /identity/v3/users => generated 295 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:14:39.603453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7b045-0404-4a1e-ae6f-6fdb6ee3fff7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:39.614719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7b045-0404-4a1e-ae6f-6fdb6ee3fff7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:39.642483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057958-8db5-4d6c-a53e-88c51cb967d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:39.643764 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057958-8db5-4d6c-a53e-88c51cb967d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:39.644125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057958-8db5-4d6c-a53e-88c51cb967d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:39.644449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057958-8db5-4d6c-a53e-88c51cb967d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:39.645156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9057958-8db5-4d6c-a53e-88c51cb967d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:39.791972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9057958-8db5-4d6c-a53e-88c51cb967d6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:39.840623 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e024315-8985-4922-84bf-086bdb85ba12 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:39.841829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1187/2373] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:14:39.852594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e024315-8985-4922-84bf-086bdb85ba12 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:39.871161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644f8a6-27a1-494e-b25d-e782f54fb8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:39.872003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644f8a6-27a1-494e-b25d-e782f54fb8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:39.872289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644f8a6-27a1-494e-b25d-e782f54fb8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:39.872569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644f8a6-27a1-494e-b25d-e782f54fb8e2 admin admin] PATH_INFO: `/v3/projects/8bd6d965a69447c58fcef38134056607/users/19a1404632f0496681651ab9487a1156/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:39.968645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644f8a6-27a1-494e-b25d-e782f54fb8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd6d965a69447c58fcef38134056607, user_id=19a1404632f0496681651ab9487a1156, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:40.024127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644f8a6-27a1-494e-b25d-e782f54fb8e2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:40.055215 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1187/2374] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:14:39 2021] PUT /identity/v3/projects/8bd6d965a69447c58fcef38134056607/users/19a1404632f0496681651ab9487a1156/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:40.060042 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285c6e-be9e-4898-a2e3-227b716c13aa None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:40.060261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285c6e-be9e-4898-a2e3-227b716c13aa None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:40.060482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285c6e-be9e-4898-a2e3-227b716c13aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:40.155627 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-55285c6e-be9e-4898-a2e3-227b716c13aa None None] MFA Rules not processed for user `19a1404632f0496681651ab9487a1156`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:40.157245 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-55285c6e-be9e-4898-a2e3-227b716c13aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:40.315156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1188/2375] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:40 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:40.324732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644f8a6-27a1-494e-b25d-e782f54fb8e2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:40.326939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-c644f8a6-27a1-494e-b25d-e782f54fb8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:40.483384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644f8a6-27a1-494e-b25d-e782f54fb8e2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:40.492174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7708cf5-c4c7-44c7-a942-41eed69ada94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:40.492798 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7708cf5-c4c7-44c7-a942-41eed69ada94 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:40.494963 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7708cf5-c4c7-44c7-a942-41eed69ada94 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:40.495310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7708cf5-c4c7-44c7-a942-41eed69ada94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:40.514339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7708cf5-c4c7-44c7-a942-41eed69ada94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:40.570140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7708cf5-c4c7-44c7-a942-41eed69ada94 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:40.598470 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1188/2376] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:40 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:42.526972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285c6e-be9e-4898-a2e3-227b716c13aa None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:42.529406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-55285c6e-be9e-4898-a2e3-227b716c13aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:42.732416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285c6e-be9e-4898-a2e3-227b716c13aa None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:42.741013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153329f3-67d4-47ee-992c-57f0b1ac520f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:42.742241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153329f3-67d4-47ee-992c-57f0b1ac520f service placement] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:42.742793 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153329f3-67d4-47ee-992c-57f0b1ac520f service placement] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:42.743271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153329f3-67d4-47ee-992c-57f0b1ac520f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:42.746283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-153329f3-67d4-47ee-992c-57f0b1ac520f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:42.761950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153329f3-67d4-47ee-992c-57f0b1ac520f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:42.790717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153329f3-67d4-47ee-992c-57f0b1ac520f service placement] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:42.805880 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1189/2377] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:42 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:14:43.806000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2ec15-e951-468b-b4bd-7a938734087c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:43.806825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2ec15-e951-468b-b4bd-7a938734087c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:43.806825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2ec15-e951-468b-b4bd-7a938734087c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:43.834573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-03e2ec15-e951-468b-b4bd-7a938734087c None None] MFA Rules not processed for user `1fefe832606e4855b0e33a7f7b582925`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:43.835795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-03e2ec15-e951-468b-b4bd-7a938734087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:43.905638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1189/2378] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:43 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:14:44.424546 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bde72-0431-48f8-b0dd-6342d6c86a20 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:44.425075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bde72-0431-48f8-b0dd-6342d6c86a20 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:44.425409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bde72-0431-48f8-b0dd-6342d6c86a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:44.471057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-838bde72-0431-48f8-b0dd-6342d6c86a20 None None] MFA Rules not processed for user `884b2c83926146828276418e0101925f`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:44.472470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-838bde72-0431-48f8-b0dd-6342d6c86a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:44.555966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1190/2379] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:44 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:14:44.560164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2ec15-e951-468b-b4bd-7a938734087c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:44.561652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-03e2ec15-e951-468b-b4bd-7a938734087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:44.633838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2ec15-e951-468b-b4bd-7a938734087c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:44.638036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5f995-264c-4c87-b1d7-26b8350d1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:44.638673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f995-264c-4c87-b1d7-26b8350d1ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:44.638964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f995-264c-4c87-b1d7-26b8350d1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:44.639249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f995-264c-4c87-b1d7-26b8350d1ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:44.639894 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5f995-264c-4c87-b1d7-26b8350d1ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:44.666427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5f995-264c-4c87-b1d7-26b8350d1ac9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:44.701404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1190/2380] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:14:44 2021] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:14:44.705722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bde72-0431-48f8-b0dd-6342d6c86a20 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:44.717040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bde72-0431-48f8-b0dd-6342d6c86a20 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:44.813940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f714d18-46ab-40cb-8160-f043348b9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:44.815516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f714d18-46ab-40cb-8160-f043348b9ade admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:44.815971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f714d18-46ab-40cb-8160-f043348b9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:44.816487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f714d18-46ab-40cb-8160-f043348b9ade admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:44.817554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f714d18-46ab-40cb-8160-f043348b9ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:44.848560 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f714d18-46ab-40cb-8160-f043348b9ade admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:44.877905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1191/2381] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:14:44 2021] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:14:44.881199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5f995-264c-4c87-b1d7-26b8350d1ac9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:44.892161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5f995-264c-4c87-b1d7-26b8350d1ac9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:44.897653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc751d1a-7ebe-4526-a058-41632e3242ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:44.898275 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc751d1a-7ebe-4526-a058-41632e3242ad admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:44.898659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc751d1a-7ebe-4526-a058-41632e3242ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:44.898961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc751d1a-7ebe-4526-a058-41632e3242ad admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:44.899627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc751d1a-7ebe-4526-a058-41632e3242ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:44.928306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc751d1a-7ebe-4526-a058-41632e3242ad admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:44.940147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1191/2382] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:14:44 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:14:44.944860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f714d18-46ab-40cb-8160-f043348b9ade admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:44.959937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f714d18-46ab-40cb-8160-f043348b9ade admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:44.979465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6114a-a73e-4c9a-ae90-470f292b8db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:44.980410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6114a-a73e-4c9a-ae90-470f292b8db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:44.980763 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6114a-a73e-4c9a-ae90-470f292b8db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:44.981144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6114a-a73e-4c9a-ae90-470f292b8db3 admin admin] PATH_INFO: `/v3/projects/8f3aa7abf0214a7cad3a40b511fc05f1/users/827c88cd693c4d1688a1648c219613a0/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:45.015277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6114a-a73e-4c9a-ae90-470f292b8db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3aa7abf0214a7cad3a40b511fc05f1, user_id=827c88cd693c4d1688a1648c219613a0, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:45.068352 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6114a-a73e-4c9a-ae90-470f292b8db3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:45.094290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1192/2383] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:14:44 2021] PUT /identity/v3/projects/8f3aa7abf0214a7cad3a40b511fc05f1/users/827c88cd693c4d1688a1648c219613a0/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:14:45.096109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc751d1a-7ebe-4526-a058-41632e3242ad admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:45.110484 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc751d1a-7ebe-4526-a058-41632e3242ad admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:45.190375 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393c3f3-c4b0-4c74-b385-010ceb5e407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:45.191035 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393c3f3-c4b0-4c74-b385-010ceb5e407f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:45.191314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393c3f3-c4b0-4c74-b385-010ceb5e407f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:45.191633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393c3f3-c4b0-4c74-b385-010ceb5e407f admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:45.192469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393c3f3-c4b0-4c74-b385-010ceb5e407f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:45.219777 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393c3f3-c4b0-4c74-b385-010ceb5e407f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:45.234421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1192/2384] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:14:45 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:14:45.235514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6114a-a73e-4c9a-ae90-470f292b8db3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:45.253295 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6114a-a73e-4c9a-ae90-470f292b8db3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:45.269837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc1bd-fa1a-4a96-bd71-bf02b3ed836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:45.270720 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc1bd-fa1a-4a96-bd71-bf02b3ed836e admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:45.271016 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc1bd-fa1a-4a96-bd71-bf02b3ed836e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:45.271452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcc1bd-fa1a-4a96-bd71-bf02b3ed836e admin admin] PATH_INFO: `/v3/projects/8f3aa7abf0214a7cad3a40b511fc05f1/users/827c88cd693c4d1688a1648c219613a0/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:45.274311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcc1bd-fa1a-4a96-bd71-bf02b3ed836e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3aa7abf0214a7cad3a40b511fc05f1, user_id=827c88cd693c4d1688a1648c219613a0, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:45.311406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcc1bd-fa1a-4a96-bd71-bf02b3ed836e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:45.331183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1193/2385] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:14:45 2021] PUT /identity/v3/projects/8f3aa7abf0214a7cad3a40b511fc05f1/users/827c88cd693c4d1688a1648c219613a0/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:45.335303 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393c3f3-c4b0-4c74-b385-010ceb5e407f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:45.347311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393c3f3-c4b0-4c74-b385-010ceb5e407f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:45.438738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb5481-ec0c-4bd0-a450-3a3f89a2c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:45.439962 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5481-ec0c-4bd0-a450-3a3f89a2c51b admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:45.440254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5481-ec0c-4bd0-a450-3a3f89a2c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:45.440713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5481-ec0c-4bd0-a450-3a3f89a2c51b admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:45.441416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb5481-ec0c-4bd0-a450-3a3f89a2c51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:45.470862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb5481-ec0c-4bd0-a450-3a3f89a2c51b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:45.487329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1193/2386] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:14:45 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:14:45.488411 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc1bd-fa1a-4a96-bd71-bf02b3ed836e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:45.498972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcc1bd-fa1a-4a96-bd71-bf02b3ed836e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:45.504389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c4fd0-4686-4ebc-9ada-55c9cef22619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:45.505213 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c4fd0-4686-4ebc-9ada-55c9cef22619 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:45.505509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c4fd0-4686-4ebc-9ada-55c9cef22619 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:45.505949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c4fd0-4686-4ebc-9ada-55c9cef22619 admin admin] PATH_INFO: `/v3/projects/8f3aa7abf0214a7cad3a40b511fc05f1/users/827c88cd693c4d1688a1648c219613a0/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:45.507780 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c4fd0-4686-4ebc-9ada-55c9cef22619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3aa7abf0214a7cad3a40b511fc05f1, user_id=827c88cd693c4d1688a1648c219613a0, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:45.535346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c4fd0-4686-4ebc-9ada-55c9cef22619 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:45.551468 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1194/2387] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:14:45 2021] PUT /identity/v3/projects/8f3aa7abf0214a7cad3a40b511fc05f1/users/827c88cd693c4d1688a1648c219613a0/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:14:55.505646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4cc4f-b441-4239-a72d-d630ee2d0d9a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:55.506279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4cc4f-b441-4239-a72d-d630ee2d0d9a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:55.506279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4cc4f-b441-4239-a72d-d630ee2d0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:55.545606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-d5f4cc4f-b441-4239-a72d-d630ee2d0d9a None None] MFA Rules not processed for user `827c88cd693c4d1688a1648c219613a0`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:14:55.546794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d5f4cc4f-b441-4239-a72d-d630ee2d0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:55.637928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1194/2388] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:14:55 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:14:55.649511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c4fd0-4686-4ebc-9ada-55c9cef22619 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:14:55.651394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-bd6c4fd0-4686-4ebc-9ada-55c9cef22619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:14:55.759311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c4fd0-4686-4ebc-9ada-55c9cef22619 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:14:55.764534 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c75c-5bc2-465b-8e25-bf5a045566ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:14:55.765120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c75c-5bc2-465b-8e25-bf5a045566ca service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:14:55.765409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c75c-5bc2-465b-8e25-bf5a045566ca service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:14:55.765692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c75c-5bc2-465b-8e25-bf5a045566ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:14:55.855834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c75c-5bc2-465b-8e25-bf5a045566ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:14:55.882992 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c75c-5bc2-465b-8e25-bf5a045566ca service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:14:55.892368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1195/2389] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:14:55 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:15:03.352147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4cc4f-b441-4239-a72d-d630ee2d0d9a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:03.424387 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4cc4f-b441-4239-a72d-d630ee2d0d9a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:03.428373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:03.429165 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:03.429450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:03.429731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] PATH_INFO: `/v3/users/19a1404632f0496681651ab9487a1156` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:03.430838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a1404632f0496681651ab9487a1156)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:03.457012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:03.540319 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a1404632f0496681651ab9487a1156'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:03.559906 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a1404632f0496681651ab9487a1156'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:03.560897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a1404632f0496681651ab9487a1156'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:03.570407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a1404632f0496681651ab9487a1156'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:03.578584 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a1404632f0496681651ab9487a1156'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:03.585993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1195/2390] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:15:03 2021] DELETE /identity/v3/users/19a1404632f0496681651ab9487a1156 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:03.590251 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e1b3-dd50-47d2-81ab-a8177ef22306 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:03.590813 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e1b3-dd50-47d2-81ab-a8177ef22306 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:03.590923 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3e1b3-dd50-47d2-81ab-a8177ef22306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:03.619328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-bfd3e1b3-dd50-47d2-81ab-a8177ef22306 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:03.620495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-bfd3e1b3-dd50-47d2-81ab-a8177ef22306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:03.723138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1196/2391] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:15:03.737830 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:03.739382 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:03.816462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdd8c9-e02b-4c85-9963-80018ca44047 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:03.822220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26c81-3efd-4ace-a407-a14523a9f083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:03.822220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26c81-3efd-4ace-a407-a14523a9f083 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:03.822220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26c81-3efd-4ace-a407-a14523a9f083 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:03.822220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26c81-3efd-4ace-a407-a14523a9f083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:03.836983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c26c81-3efd-4ace-a407-a14523a9f083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:03.866192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c26c81-3efd-4ace-a407-a14523a9f083 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:03.877059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1196/2392] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:15:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:15:04.384481 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3e1b3-dd50-47d2-81ab-a8177ef22306 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:04.386897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-bfd3e1b3-dd50-47d2-81ab-a8177ef22306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:04.404713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3e1b3-dd50-47d2-81ab-a8177ef22306 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:04.410392 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:04.411297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:04.411585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:04.411868 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] PATH_INFO: `/v3/projects/8bd6d965a69447c58fcef38134056607` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:04.412957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd6d965a69447c58fcef38134056607)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:04.440264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:04.500336 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd6d965a69447c58fcef38134056607', 'request_id': 'req-2fb04058-1401-4ebe-926e-a9fb09178fb8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:04.513064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd6d965a69447c58fcef38134056607', 'request_id': 'req-2fb04058-1401-4ebe-926e-a9fb09178fb8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:04.521610 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd6d965a69447c58fcef38134056607', 'request_id': 'req-2fb04058-1401-4ebe-926e-a9fb09178fb8'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:04.534449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] The token cache is being invalidate because project 8bd6d965a69447c58fcef38134056607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:15:04.534955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:04.535708 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-2fb04058-1401-4ebe-926e-a9fb09178fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:04.542737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1197/2393] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:15:04 2021] DELETE /identity/v3/projects/8bd6d965a69447c58fcef38134056607 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:14.003561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26c81-3efd-4ace-a407-a14523a9f083 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:14.005199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d4c26c81-3efd-4ace-a407-a14523a9f083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:14.018861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26c81-3efd-4ace-a407-a14523a9f083 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:14.111961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:14.112685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:14.112852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:14.113137 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:14.115064 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:14.281424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:14.318339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:14.334652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1197/2394] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:15:14 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:15:23.318503 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb72eb-665c-44c1-b38d-c30d284266ff None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:23.319193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb72eb-665c-44c1-b38d-c30d284266ff None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:23.319193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb72eb-665c-44c1-b38d-c30d284266ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:23.392443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-9eeb72eb-665c-44c1-b38d-c30d284266ff None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:23.393751 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9eeb72eb-665c-44c1-b38d-c30d284266ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:23.465065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1198/2395] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:15:23 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:23.477024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:23.478338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:23.578676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd13fcc-662b-4cd1-856d-62fcd4018c8b service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:23.583435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce6afe-c8d5-4e9c-b5b6-82ac8affc56c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:23.584013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce6afe-c8d5-4e9c-b5b6-82ac8affc56c service swift] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:23.584299 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce6afe-c8d5-4e9c-b5b6-82ac8affc56c service swift] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:23.584579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce6afe-c8d5-4e9c-b5b6-82ac8affc56c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:23.592570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce6afe-c8d5-4e9c-b5b6-82ac8affc56c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:23.618209 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce6afe-c8d5-4e9c-b5b6-82ac8affc56c service swift] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:23.626800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1198/2396] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:15:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 14:15:29.731070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e545808-6f69-45be-8cde-9bde50d05b2c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:29.732061 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e545808-6f69-45be-8cde-9bde50d05b2c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:29.732357 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e545808-6f69-45be-8cde-9bde50d05b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:29.761157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-3e545808-6f69-45be-8cde-9bde50d05b2c None None] MFA Rules not processed for user `884b2c83926146828276418e0101925f`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:29.762394 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3e545808-6f69-45be-8cde-9bde50d05b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:29.952705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1199/2397] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:29 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:46.773145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88cc89-8bf8-4a8e-b8b9-4b9ca8320434 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:46.773691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88cc89-8bf8-4a8e-b8b9-4b9ca8320434 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:46.773691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88cc89-8bf8-4a8e-b8b9-4b9ca8320434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:46.800749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3f88cc89-8bf8-4a8e-b8b9-4b9ca8320434 None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:46.801990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3f88cc89-8bf8-4a8e-b8b9-4b9ca8320434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:46.815231 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1199/2398] 10.222.0.36 () {58 vars in 967 bytes} [Wed Oct 27 14:15:46 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:46.828664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e545808-6f69-45be-8cde-9bde50d05b2c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:46.849182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e545808-6f69-45be-8cde-9bde50d05b2c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:46.857174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afba377-6db8-4df3-9495-260190e3e089 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:46.858027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afba377-6db8-4df3-9495-260190e3e089 service swift] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:46.858512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afba377-6db8-4df3-9495-260190e3e089 service swift] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:46.859460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afba377-6db8-4df3-9495-260190e3e089 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:46.869325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afba377-6db8-4df3-9495-260190e3e089 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:46.896151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afba377-6db8-4df3-9495-260190e3e089 service swift] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:46.912365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1200/2399] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:15:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:15:49.343647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88cc89-8bf8-4a8e-b8b9-4b9ca8320434 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:49.345159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3f88cc89-8bf8-4a8e-b8b9-4b9ca8320434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:49.416445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88cc89-8bf8-4a8e-b8b9-4b9ca8320434 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:49.421003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:49.422417 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:49.422731 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:49.423017 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] PATH_INFO: `/v3/users/1fefe832606e4855b0e33a7f7b582925` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:49.424118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fefe832606e4855b0e33a7f7b582925)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:49.449341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:49.501411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fefe832606e4855b0e33a7f7b582925'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.513524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fefe832606e4855b0e33a7f7b582925'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.514190 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fefe832606e4855b0e33a7f7b582925'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.523074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fefe832606e4855b0e33a7f7b582925'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.531124 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b45f3100-c945-46f2-a6ea-80b9d9f13cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fefe832606e4855b0e33a7f7b582925'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.537482 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1200/2400] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:15:49 2021] DELETE /identity/v3/users/1fefe832606e4855b0e33a7f7b582925 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:49.775948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afba377-6db8-4df3-9495-260190e3e089 service swift] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:49.787976 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afba377-6db8-4df3-9495-260190e3e089 service swift] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:49.855479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:49.856280 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:49.856572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:49.856862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] PATH_INFO: `/v3/projects/f1bedd96b4a0478daa1b806d41483aaf` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:49.857934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bedd96b4a0478daa1b806d41483aaf)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:49.883942 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:49.935907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bedd96b4a0478daa1b806d41483aaf', 'request_id': 'req-587e6efd-019e-4672-9797-86aa2a8c2dad'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.947331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bedd96b4a0478daa1b806d41483aaf', 'request_id': 'req-587e6efd-019e-4672-9797-86aa2a8c2dad'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.955728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bedd96b4a0478daa1b806d41483aaf', 'request_id': 'req-587e6efd-019e-4672-9797-86aa2a8c2dad'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.966420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] The token cache is being invalidate because project f1bedd96b4a0478daa1b806d41483aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:15:49.966754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.967384 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-587e6efd-019e-4672-9797-86aa2a8c2dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:49.969896 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1201/2401] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:15:49 2021] DELETE /identity/v3/projects/f1bedd96b4a0478daa1b806d41483aaf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:49.975656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71db04-0588-461b-8b34-8c0201637d35 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:49.975953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71db04-0588-461b-8b34-8c0201637d35 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:49.976230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71db04-0588-461b-8b34-8c0201637d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:49.999339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7d71db04-0588-461b-8b34-8c0201637d35 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:50.000983 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7d71db04-0588-461b-8b34-8c0201637d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:50.070586 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1201/2402] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:15:50.079126 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b82d58-91a3-47f3-b207-2038b9523b73 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:50.079421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b82d58-91a3-47f3-b207-2038b9523b73 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:50.079705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b82d58-91a3-47f3-b207-2038b9523b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:50.103915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-87b82d58-91a3-47f3-b207-2038b9523b73 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:50.105068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-87b82d58-91a3-47f3-b207-2038b9523b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:50.112383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1202/2403] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:50.116760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71db04-0588-461b-8b34-8c0201637d35 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:50.127503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71db04-0588-461b-8b34-8c0201637d35 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:50.131832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918020-dd2f-43ff-8f2a-64eb9dd821a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:50.132436 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918020-dd2f-43ff-8f2a-64eb9dd821a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:50.132718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918020-dd2f-43ff-8f2a-64eb9dd821a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:50.133012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918020-dd2f-43ff-8f2a-64eb9dd821a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:50.133703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918020-dd2f-43ff-8f2a-64eb9dd821a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:15:50.134005 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918020-dd2f-43ff-8f2a-64eb9dd821a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:50.161328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918020-dd2f-43ff-8f2a-64eb9dd821a7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:50.174823 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1202/2404] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:15:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:15:50.179027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b82d58-91a3-47f3-b207-2038b9523b73 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:50.188657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b82d58-91a3-47f3-b207-2038b9523b73 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:50.193601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f623d6-e75b-450d-9440-5a9116bacb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:50.194200 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f623d6-e75b-450d-9440-5a9116bacb7f admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:50.194500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f623d6-e75b-450d-9440-5a9116bacb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:50.194833 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f623d6-e75b-450d-9440-5a9116bacb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:50.195470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f623d6-e75b-450d-9440-5a9116bacb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:50.222029 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f623d6-e75b-450d-9440-5a9116bacb7f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:50.250193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1203/2405] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:15:50 2021] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:15:50.254294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918020-dd2f-43ff-8f2a-64eb9dd821a7 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:50.263614 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918020-dd2f-43ff-8f2a-64eb9dd821a7 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:50.328398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f4145-990b-4205-b134-44c56347ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:50.329001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4145-990b-4205-b134-44c56347ec36 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:50.329289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4145-990b-4205-b134-44c56347ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:50.329571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4145-990b-4205-b134-44c56347ec36 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:50.330202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f4145-990b-4205-b134-44c56347ec36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:50.355330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f4145-990b-4205-b134-44c56347ec36 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:50.375997 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1203/2406] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:15:50 2021] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:15:50.379936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f623d6-e75b-450d-9440-5a9116bacb7f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:50.390037 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f623d6-e75b-450d-9440-5a9116bacb7f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:50.395377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724722f-c647-48f2-8126-75015a873b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:50.395960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724722f-c647-48f2-8126-75015a873b18 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:50.396248 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724722f-c647-48f2-8126-75015a873b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:50.396620 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724722f-c647-48f2-8126-75015a873b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:50.397206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724722f-c647-48f2-8126-75015a873b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:50.423167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724722f-c647-48f2-8126-75015a873b18 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:50.433734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1204/2407] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:15:50 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:15:50.438594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f4145-990b-4205-b134-44c56347ec36 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:50.448656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f4145-990b-4205-b134-44c56347ec36 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:50.453964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88ab93-4982-4809-92cf-8dffc45eb24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:50.454833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88ab93-4982-4809-92cf-8dffc45eb24c admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:50.455013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88ab93-4982-4809-92cf-8dffc45eb24c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:50.455493 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88ab93-4982-4809-92cf-8dffc45eb24c admin admin] PATH_INFO: `/v3/projects/b050c3e6f12d48f98e0c47c117d8c270/users/e5a0fed75e1e4605aa9a470b9a65e271/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:50.475985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88ab93-4982-4809-92cf-8dffc45eb24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b050c3e6f12d48f98e0c47c117d8c270, user_id=e5a0fed75e1e4605aa9a470b9a65e271, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:50.503583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88ab93-4982-4809-92cf-8dffc45eb24c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:50.516793 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1204/2408] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:15:50 2021] PUT /identity/v3/projects/b050c3e6f12d48f98e0c47c117d8c270/users/e5a0fed75e1e4605aa9a470b9a65e271/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:15:50.528578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a3ff-50eb-4e15-99ac-100963ef1cdd None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:50.528578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a3ff-50eb-4e15-99ac-100963ef1cdd None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:50.528578 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a3ff-50eb-4e15-99ac-100963ef1cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:50.568431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e275a3ff-50eb-4e15-99ac-100963ef1cdd None None] MFA Rules not processed for user `e5a0fed75e1e4605aa9a470b9a65e271`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:50.569663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e275a3ff-50eb-4e15-99ac-100963ef1cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:50.648445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1205/2409] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:50 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:50.659833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88ab93-4982-4809-92cf-8dffc45eb24c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:50.661420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5e88ab93-4982-4809-92cf-8dffc45eb24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:50.753785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88ab93-4982-4809-92cf-8dffc45eb24c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:50.757159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed36581-0f2d-4f51-bbfc-3eb23b564b4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ddc229d1a0446c83956f9f0c1ddbfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:50.757766 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed36581-0f2d-4f51-bbfc-3eb23b564b4f service glance] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:50.758051 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed36581-0f2d-4f51-bbfc-3eb23b564b4f service glance] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:50.758331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed36581-0f2d-4f51-bbfc-3eb23b564b4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:50.766615 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed36581-0f2d-4f51-bbfc-3eb23b564b4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:50.791773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed36581-0f2d-4f51-bbfc-3eb23b564b4f service glance] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:50.802733 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1205/2410] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:15:50 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:15:51.218590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a3ff-50eb-4e15-99ac-100963ef1cdd None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:51.220519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e275a3ff-50eb-4e15-99ac-100963ef1cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:51.299823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a3ff-50eb-4e15-99ac-100963ef1cdd None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:51.303452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ab18d-5bad-4085-bbe0-dc723e4342a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:51.304047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab18d-5bad-4085-bbe0-dc723e4342a6 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:51.304376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab18d-5bad-4085-bbe0-dc723e4342a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:51.304656 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab18d-5bad-4085-bbe0-dc723e4342a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:51.306359 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cb6ab18d-5bad-4085-bbe0-dc723e4342a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:51.385949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ab18d-5bad-4085-bbe0-dc723e4342a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:51.417015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ab18d-5bad-4085-bbe0-dc723e4342a6 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:51.430905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1206/2411] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:15:51 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:15:54.148329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed36581-0f2d-4f51-bbfc-3eb23b564b4f service glance] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:54.149927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0ed36581-0f2d-4f51-bbfc-3eb23b564b4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:54.239015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed36581-0f2d-4f51-bbfc-3eb23b564b4f service glance] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:54.243426 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:54.244268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:54.244921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:54.244921 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] PATH_INFO: `/v3/users/d33fa612914a45dca090798991b8dfb0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:54.246008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33fa612914a45dca090798991b8dfb0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:54.272321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:54.345029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33fa612914a45dca090798991b8dfb0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.359767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33fa612914a45dca090798991b8dfb0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.360127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33fa612914a45dca090798991b8dfb0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.371032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33fa612914a45dca090798991b8dfb0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.380147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2c432e63-4ddd-47d1-b7d3-90b53c88cb98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33fa612914a45dca090798991b8dfb0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.386834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1206/2412] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:15:54 2021] DELETE /identity/v3/users/d33fa612914a45dca090798991b8dfb0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:54.646315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ab18d-5bad-4085-bbe0-dc723e4342a6 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:54.659410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ab18d-5bad-4085-bbe0-dc723e4342a6 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:54.738392 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:54.739331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:54.739687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:54.740089 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] PATH_INFO: `/v3/projects/32e064bd64034775bfe5271d56d189d9` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:54.741277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e064bd64034775bfe5271d56d189d9)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:54.769653 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:54.832898 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e064bd64034775bfe5271d56d189d9', 'request_id': 'req-89b73d9b-3df8-484a-bccf-ca395d0cc59a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.845722 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e064bd64034775bfe5271d56d189d9', 'request_id': 'req-89b73d9b-3df8-484a-bccf-ca395d0cc59a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.853661 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e064bd64034775bfe5271d56d189d9', 'request_id': 'req-89b73d9b-3df8-484a-bccf-ca395d0cc59a'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.867657 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] The token cache is being invalidate because project 32e064bd64034775bfe5271d56d189d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:15:54.868086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.868855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-89b73d9b-3df8-484a-bccf-ca395d0cc59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:54.870537 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1207/2413] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:15:54 2021] DELETE /identity/v3/projects/32e064bd64034775bfe5271d56d189d9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:54.878254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725531-72bb-4624-84a0-877e47b1026e None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:54.878890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725531-72bb-4624-84a0-877e47b1026e None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:54.879501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725531-72bb-4624-84a0-877e47b1026e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:54.915233 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-b0725531-72bb-4624-84a0-877e47b1026e None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:54.916647 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b0725531-72bb-4624-84a0-877e47b1026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:54.991282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1207/2414] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:15:54.999842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82015f3-558b-457c-bb42-bd4b5c9ea8e7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.000293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82015f3-558b-457c-bb42-bd4b5c9ea8e7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.000781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82015f3-558b-457c-bb42-bd4b5c9ea8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.024569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a82015f3-558b-457c-bb42-bd4b5c9ea8e7 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:55.026121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a82015f3-558b-457c-bb42-bd4b5c9ea8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:55.034368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1208/2415] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:55.038272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0725531-72bb-4624-84a0-877e47b1026e None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:55.049281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0725531-72bb-4624-84a0-877e47b1026e None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:55.055362 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572d2d9-ebf6-4620-966a-345437cd8878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:55.056396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572d2d9-ebf6-4620-966a-345437cd8878 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.056892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572d2d9-ebf6-4620-966a-345437cd8878 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.057404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572d2d9-ebf6-4620-966a-345437cd8878 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.058361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572d2d9-ebf6-4620-966a-345437cd8878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:15:55.059029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572d2d9-ebf6-4620-966a-345437cd8878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:55.087110 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572d2d9-ebf6-4620-966a-345437cd8878 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:55.103498 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1208/2416] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:15:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:15:55.109001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82015f3-558b-457c-bb42-bd4b5c9ea8e7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:55.120435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82015f3-558b-457c-bb42-bd4b5c9ea8e7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:55.128539 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf9cff-8a90-4153-86e1-4d393b5a0111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:55.129588 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf9cff-8a90-4153-86e1-4d393b5a0111 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.130124 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf9cff-8a90-4153-86e1-4d393b5a0111 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.130656 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf9cff-8a90-4153-86e1-4d393b5a0111 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.131514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf9cff-8a90-4153-86e1-4d393b5a0111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:55.157884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf9cff-8a90-4153-86e1-4d393b5a0111 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:55.188001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1209/2417] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:15:55 2021] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:15:55.192373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572d2d9-ebf6-4620-966a-345437cd8878 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:55.201959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572d2d9-ebf6-4620-966a-345437cd8878 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:55.267272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0b59a-8822-4520-a395-59290d005c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:55.267900 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0b59a-8822-4520-a395-59290d005c19 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.268175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0b59a-8822-4520-a395-59290d005c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.268454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0b59a-8822-4520-a395-59290d005c19 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.269096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0b59a-8822-4520-a395-59290d005c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:55.294972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0b59a-8822-4520-a395-59290d005c19 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:55.320449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1209/2418] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:15:55 2021] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:15:55.324570 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf9cff-8a90-4153-86e1-4d393b5a0111 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:55.336186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf9cff-8a90-4153-86e1-4d393b5a0111 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:55.340528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855955e-64e9-457b-9849-9f065fb85f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:55.341131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855955e-64e9-457b-9849-9f065fb85f95 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.341424 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855955e-64e9-457b-9849-9f065fb85f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.341971 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855955e-64e9-457b-9849-9f065fb85f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.342392 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855955e-64e9-457b-9849-9f065fb85f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:55.369485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855955e-64e9-457b-9849-9f065fb85f95 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:55.381402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1210/2419] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:15:55 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:15:55.385131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0b59a-8822-4520-a395-59290d005c19 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:55.395909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0b59a-8822-4520-a395-59290d005c19 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:55.400286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69177da2-c9b2-4911-b743-d4d31ffd24ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:55.401227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69177da2-c9b2-4911-b743-d4d31ffd24ea admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.401516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69177da2-c9b2-4911-b743-d4d31ffd24ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.401795 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69177da2-c9b2-4911-b743-d4d31ffd24ea admin admin] PATH_INFO: `/v3/projects/2297644cd713411e9b2553c7dd4bc388/users/b16c3e08f1d3447f8cde958f3800ef22/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.425211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69177da2-c9b2-4911-b743-d4d31ffd24ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2297644cd713411e9b2553c7dd4bc388, user_id=b16c3e08f1d3447f8cde958f3800ef22, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:55.452000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69177da2-c9b2-4911-b743-d4d31ffd24ea admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:55.472272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1210/2420] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:15:55 2021] PUT /identity/v3/projects/2297644cd713411e9b2553c7dd4bc388/users/b16c3e08f1d3447f8cde958f3800ef22/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:55.484941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9619-90a8-47ea-99c9-b77228b570be None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.485565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9619-90a8-47ea-99c9-b77228b570be None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.485964 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9619-90a8-47ea-99c9-b77228b570be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.529743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-9a9c9619-90a8-47ea-99c9-b77228b570be None None] MFA Rules not processed for user `b16c3e08f1d3447f8cde958f3800ef22`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:55.531383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9a9c9619-90a8-47ea-99c9-b77228b570be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:55.628614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1211/2421] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:55 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:55.633062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69177da2-c9b2-4911-b743-d4d31ffd24ea admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:55.736501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69177da2-c9b2-4911-b743-d4d31ffd24ea admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:55.740752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f46a-87c9-467d-bb1a-0ce0be4aa3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:55.741339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f46a-87c9-467d-bb1a-0ce0be4aa3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.741628 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f46a-87c9-467d-bb1a-0ce0be4aa3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.741908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f46a-87c9-467d-bb1a-0ce0be4aa3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.742540 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27f46a-87c9-467d-bb1a-0ce0be4aa3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:55.769243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27f46a-87c9-467d-bb1a-0ce0be4aa3d4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:55.796697 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1211/2422] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:15:55 2021] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:15:55.800948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c9619-90a8-47ea-99c9-b77228b570be None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:55.811432 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c9619-90a8-47ea-99c9-b77228b570be None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:55.890268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367bb3a-8d4b-406f-a2da-af80871e17b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:55.890938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367bb3a-8d4b-406f-a2da-af80871e17b9 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.891236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367bb3a-8d4b-406f-a2da-af80871e17b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.891527 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367bb3a-8d4b-406f-a2da-af80871e17b9 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.892192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367bb3a-8d4b-406f-a2da-af80871e17b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:55.918407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367bb3a-8d4b-406f-a2da-af80871e17b9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:55.939360 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1212/2423] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:15:55 2021] POST /identity/v3/users => generated 301 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:15:55.944284 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f46a-87c9-467d-bb1a-0ce0be4aa3d4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:55.956240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f46a-87c9-467d-bb1a-0ce0be4aa3d4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:55.960410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc578147-31d4-47e2-a9a6-f223f616133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:55.961000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc578147-31d4-47e2-a9a6-f223f616133d admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:55.961293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc578147-31d4-47e2-a9a6-f223f616133d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:55.961583 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc578147-31d4-47e2-a9a6-f223f616133d admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:55.962269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc578147-31d4-47e2-a9a6-f223f616133d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:55.988912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc578147-31d4-47e2-a9a6-f223f616133d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:56.001396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1212/2424] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:15:55 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:15:56.005418 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367bb3a-8d4b-406f-a2da-af80871e17b9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:56.015850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367bb3a-8d4b-406f-a2da-af80871e17b9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:56.020219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccab170-0317-4e6d-9d52-b47e45faea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:56.021070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab170-0317-4e6d-9d52-b47e45faea53 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:56.021348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab170-0317-4e6d-9d52-b47e45faea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:56.021623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab170-0317-4e6d-9d52-b47e45faea53 admin admin] PATH_INFO: `/v3/projects/219d0075008b40238d515e47b4dfd66d/users/17fdae68a656438eac565bf48f3e81f0/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:56.041961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccab170-0317-4e6d-9d52-b47e45faea53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219d0075008b40238d515e47b4dfd66d, user_id=17fdae68a656438eac565bf48f3e81f0, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:56.068669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccab170-0317-4e6d-9d52-b47e45faea53 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:56.086213 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1213/2425] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:15:56 2021] PUT /identity/v3/projects/219d0075008b40238d515e47b4dfd66d/users/17fdae68a656438eac565bf48f3e81f0/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:56.090267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc578147-31d4-47e2-a9a6-f223f616133d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:56.100985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc578147-31d4-47e2-a9a6-f223f616133d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:56.169806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07dec34-aaad-417a-af15-011d2f291c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:56.170419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dec34-aaad-417a-af15-011d2f291c63 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:56.170742 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dec34-aaad-417a-af15-011d2f291c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:56.171032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dec34-aaad-417a-af15-011d2f291c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:56.172019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dec34-aaad-417a-af15-011d2f291c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:56.197948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dec34-aaad-417a-af15-011d2f291c63 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:56.209047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1213/2426] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:15:56 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:15:56.213229 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccab170-0317-4e6d-9d52-b47e45faea53 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:56.223391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccab170-0317-4e6d-9d52-b47e45faea53 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:56.227599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba18563-504c-4bc5-9e74-ca930123469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:56.228402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba18563-504c-4bc5-9e74-ca930123469d admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:56.228687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba18563-504c-4bc5-9e74-ca930123469d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:56.228969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba18563-504c-4bc5-9e74-ca930123469d admin admin] PATH_INFO: `/v3/projects/219d0075008b40238d515e47b4dfd66d/users/17fdae68a656438eac565bf48f3e81f0/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:56.230770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba18563-504c-4bc5-9e74-ca930123469d admin admin] RBAC: Authorizing `identity:create_grant(project_id=219d0075008b40238d515e47b4dfd66d, user_id=17fdae68a656438eac565bf48f3e81f0, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:56.257825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba18563-504c-4bc5-9e74-ca930123469d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:56.269034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1214/2427] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:15:56 2021] PUT /identity/v3/projects/219d0075008b40238d515e47b4dfd66d/users/17fdae68a656438eac565bf48f3e81f0/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:56.273150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07dec34-aaad-417a-af15-011d2f291c63 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:56.283413 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07dec34-aaad-417a-af15-011d2f291c63 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:56.350055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98691e-f7e9-4ebd-bfb5-3ae200abb73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:56.350679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98691e-f7e9-4ebd-bfb5-3ae200abb73c admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:56.350970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98691e-f7e9-4ebd-bfb5-3ae200abb73c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:56.351253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98691e-f7e9-4ebd-bfb5-3ae200abb73c admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:56.351939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98691e-f7e9-4ebd-bfb5-3ae200abb73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:56.377975 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98691e-f7e9-4ebd-bfb5-3ae200abb73c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:56.387953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1214/2428] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:15:56 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:15:56.392769 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba18563-504c-4bc5-9e74-ca930123469d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:56.402515 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba18563-504c-4bc5-9e74-ca930123469d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:56.407034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb95688-a426-4b2b-b283-8b8aad75aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:56.407836 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb95688-a426-4b2b-b283-8b8aad75aaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:56.408123 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb95688-a426-4b2b-b283-8b8aad75aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:56.408403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb95688-a426-4b2b-b283-8b8aad75aaf7 admin admin] PATH_INFO: `/v3/projects/219d0075008b40238d515e47b4dfd66d/users/17fdae68a656438eac565bf48f3e81f0/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:56.410098 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb95688-a426-4b2b-b283-8b8aad75aaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219d0075008b40238d515e47b4dfd66d, user_id=17fdae68a656438eac565bf48f3e81f0, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:56.436143 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb95688-a426-4b2b-b283-8b8aad75aaf7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:56.450960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1215/2429] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:15:56 2021] PUT /identity/v3/projects/219d0075008b40238d515e47b4dfd66d/users/17fdae68a656438eac565bf48f3e81f0/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:56.462703 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed39abc-4932-4f54-8a36-383f37b7ad98 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:56.463034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed39abc-4932-4f54-8a36-383f37b7ad98 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:56.463321 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed39abc-4932-4f54-8a36-383f37b7ad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:56.504305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-1ed39abc-4932-4f54-8a36-383f37b7ad98 None None] MFA Rules not processed for user `17fdae68a656438eac565bf48f3e81f0`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:56.505468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1ed39abc-4932-4f54-8a36-383f37b7ad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:56.591936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1215/2430] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:56 2021] POST /identity/v3/auth/tokens => generated 3763 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:56.601705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb95688-a426-4b2b-b283-8b8aad75aaf7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:56.603310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8bb95688-a426-4b2b-b283-8b8aad75aaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:56.695889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb95688-a426-4b2b-b283-8b8aad75aaf7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:56.699436 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae8a5-4b86-4ea9-9860-1fd95934254c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:56.700018 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae8a5-4b86-4ea9-9860-1fd95934254c service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:56.700308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae8a5-4b86-4ea9-9860-1fd95934254c service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:56.700590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae8a5-4b86-4ea9-9860-1fd95934254c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:56.709694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae8a5-4b86-4ea9-9860-1fd95934254c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:56.736084 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae8a5-4b86-4ea9-9860-1fd95934254c service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:56.746010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1216/2431] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:15:56 2021] GET /identity/v3/auth/tokens => generated 3763 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:15:56.993723 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed39abc-4932-4f54-8a36-383f37b7ad98 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:57.065068 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed39abc-4932-4f54-8a36-383f37b7ad98 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:57.069125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:57.069922 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:57.070212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:57.070495 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] PATH_INFO: `/v3/users/b16c3e08f1d3447f8cde958f3800ef22` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:57.071724 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16c3e08f1d3447f8cde958f3800ef22)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:57.100766 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:57.150342 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16c3e08f1d3447f8cde958f3800ef22'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.161899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16c3e08f1d3447f8cde958f3800ef22'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.162595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16c3e08f1d3447f8cde958f3800ef22'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.171086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16c3e08f1d3447f8cde958f3800ef22'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.183026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16c3e08f1d3447f8cde958f3800ef22'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.189938 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1216/2432] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:15:56 2021] DELETE /identity/v3/users/b16c3e08f1d3447f8cde958f3800ef22 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:57.194431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5e110-44bb-46bf-b319-b46b8a7a14a5 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:57.194925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5e110-44bb-46bf-b319-b46b8a7a14a5 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:57.195048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5e110-44bb-46bf-b319-b46b8a7a14a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:57.217202 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-fbd5e110-44bb-46bf-b319-b46b8a7a14a5 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:57.218353 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fbd5e110-44bb-46bf-b319-b46b8a7a14a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:57.284937 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1217/2433] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:15:57.295591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:57.297550 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:57.361403 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca3a9-2c1b-49e3-a9c5-e72a7a9313d9 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:57.364735 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a0d44-d4a1-4d2d-814f-c2036b83f465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:57.365322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a0d44-d4a1-4d2d-814f-c2036b83f465 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:57.365614 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a0d44-d4a1-4d2d-814f-c2036b83f465 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:57.365910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a0d44-d4a1-4d2d-814f-c2036b83f465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:57.375432 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a0d44-d4a1-4d2d-814f-c2036b83f465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:57.400509 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a0d44-d4a1-4d2d-814f-c2036b83f465 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:57.410841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1217/2434] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:15:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:15:57.767206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5e110-44bb-46bf-b319-b46b8a7a14a5 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:57.768448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fbd5e110-44bb-46bf-b319-b46b8a7a14a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:57.781799 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5e110-44bb-46bf-b319-b46b8a7a14a5 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:57.786479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:57.787299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:57.787592 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:57.787878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] PATH_INFO: `/v3/projects/2297644cd713411e9b2553c7dd4bc388` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:57.788945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2297644cd713411e9b2553c7dd4bc388)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:57.815198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:57.872483 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2297644cd713411e9b2553c7dd4bc388', 'request_id': 'req-16dc3125-a788-4a50-8172-fcb0cca1f17d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.883428 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2297644cd713411e9b2553c7dd4bc388', 'request_id': 'req-16dc3125-a788-4a50-8172-fcb0cca1f17d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.891056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2297644cd713411e9b2553c7dd4bc388', 'request_id': 'req-16dc3125-a788-4a50-8172-fcb0cca1f17d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.900759 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] The token cache is being invalidate because project 2297644cd713411e9b2553c7dd4bc388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:15:57.901040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.901613 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:57.903058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1218/2435] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:15:57 2021] DELETE /identity/v3/projects/2297644cd713411e9b2553c7dd4bc388 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:57.907779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a0d44-d4a1-4d2d-814f-c2036b83f465 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:57.916967 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a0d44-d4a1-4d2d-814f-c2036b83f465 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:57.982473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:57.983371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:57.984256 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:57.984544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] PATH_INFO: `/v3/users/17fdae68a656438eac565bf48f3e81f0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:57.985986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fdae68a656438eac565bf48f3e81f0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:58.011888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:58.084458 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fdae68a656438eac565bf48f3e81f0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.102676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fdae68a656438eac565bf48f3e81f0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.103700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fdae68a656438eac565bf48f3e81f0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.114208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fdae68a656438eac565bf48f3e81f0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.123145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-581d2b7e-cf1e-4279-9dc0-90fef3c4873b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fdae68a656438eac565bf48f3e81f0'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.130989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1218/2436] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:15:57 2021] DELETE /identity/v3/users/17fdae68a656438eac565bf48f3e81f0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:58.505449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:58.507342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:58.522495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc3125-a788-4a50-8172-fcb0cca1f17d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:58.588139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:58.588934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:58.589219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:58.589501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] PATH_INFO: `/v3/projects/219d0075008b40238d515e47b4dfd66d` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:58.590566 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219d0075008b40238d515e47b4dfd66d)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:58.616233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:58.665932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219d0075008b40238d515e47b4dfd66d', 'request_id': 'req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.677658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219d0075008b40238d515e47b4dfd66d', 'request_id': 'req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.684669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219d0075008b40238d515e47b4dfd66d', 'request_id': 'req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.695451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] The token cache is being invalidate because project 219d0075008b40238d515e47b4dfd66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:15:58.695739 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.696328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-14a8afad-787c-4b0f-8d0d-bad5dcd4f4b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:15:58.697737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1219/2437] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:15:58 2021] DELETE /identity/v3/projects/219d0075008b40238d515e47b4dfd66d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:58.704020 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ffc02-8f60-4347-9a2a-235543117e1b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:58.704521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ffc02-8f60-4347-9a2a-235543117e1b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:58.704626 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ffc02-8f60-4347-9a2a-235543117e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:58.731977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-fd1ffc02-8f60-4347-9a2a-235543117e1b None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:58.733950 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fd1ffc02-8f60-4347-9a2a-235543117e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:58.812955 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1219/2438] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:58.820787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c9b57-758f-4d8d-ac9e-38e6d08f3c97 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:58.821176 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c9b57-758f-4d8d-ac9e-38e6d08f3c97 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:58.821462 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c9b57-758f-4d8d-ac9e-38e6d08f3c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:58.844463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-193c9b57-758f-4d8d-ac9e-38e6d08f3c97 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:58.845604 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-193c9b57-758f-4d8d-ac9e-38e6d08f3c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:58.852615 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1220/2439] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:58.857078 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ffc02-8f60-4347-9a2a-235543117e1b None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:58.867212 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ffc02-8f60-4347-9a2a-235543117e1b None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:58.871487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f775cc9-ef47-4ee0-8743-b934795b7462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:58.872075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f775cc9-ef47-4ee0-8743-b934795b7462 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:58.872367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f775cc9-ef47-4ee0-8743-b934795b7462 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:58.872652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f775cc9-ef47-4ee0-8743-b934795b7462 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:58.873337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f775cc9-ef47-4ee0-8743-b934795b7462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:15:58.873640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f775cc9-ef47-4ee0-8743-b934795b7462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:58.899080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f775cc9-ef47-4ee0-8743-b934795b7462 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:58.912083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1220/2440] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:15:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:15:58.916564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c9b57-758f-4d8d-ac9e-38e6d08f3c97 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:58.926153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c9b57-758f-4d8d-ac9e-38e6d08f3c97 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:58.930413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ab09-c924-46b0-bb3c-639e2ff3545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:58.931026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ab09-c924-46b0-bb3c-639e2ff3545e admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:58.931332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ab09-c924-46b0-bb3c-639e2ff3545e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:58.931601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ab09-c924-46b0-bb3c-639e2ff3545e admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:58.932233 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17ab09-c924-46b0-bb3c-639e2ff3545e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:58.959453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17ab09-c924-46b0-bb3c-639e2ff3545e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:58.989438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1221/2441] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:15:58 2021] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:15:58.993500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f775cc9-ef47-4ee0-8743-b934795b7462 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.003910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f775cc9-ef47-4ee0-8743-b934795b7462 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:59.070933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e3c8b-9494-4c04-9273-ac401fdcca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:59.071542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e3c8b-9494-4c04-9273-ac401fdcca0d admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.071832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e3c8b-9494-4c04-9273-ac401fdcca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.072115 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e3c8b-9494-4c04-9273-ac401fdcca0d admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.072739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e3c8b-9494-4c04-9273-ac401fdcca0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:59.099098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e3c8b-9494-4c04-9273-ac401fdcca0d admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:59.120263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1221/2442] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:15:58 2021] POST /identity/v3/users => generated 305 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:15:59.124693 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ab09-c924-46b0-bb3c-639e2ff3545e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.138003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ab09-c924-46b0-bb3c-639e2ff3545e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:59.143215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad4baa-2917-42a5-9e6f-561d44347ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:59.143925 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad4baa-2917-42a5-9e6f-561d44347ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.144290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad4baa-2917-42a5-9e6f-561d44347ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.144705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad4baa-2917-42a5-9e6f-561d44347ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.145498 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad4baa-2917-42a5-9e6f-561d44347ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:59.172846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad4baa-2917-42a5-9e6f-561d44347ca9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:59.183660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1222/2443] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:15:59.188126 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e3c8b-9494-4c04-9273-ac401fdcca0d admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.197757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e3c8b-9494-4c04-9273-ac401fdcca0d admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:59.202022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498db7e-43e7-4fa1-9374-ac24915163b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:59.203336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498db7e-43e7-4fa1-9374-ac24915163b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.203628 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498db7e-43e7-4fa1-9374-ac24915163b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.203914 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498db7e-43e7-4fa1-9374-ac24915163b0 admin admin] PATH_INFO: `/v3/projects/8ea8e4a395c046c6af2faee055ac3633/users/e8cc271d84a247cebe7f6781a4b61330/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.225653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498db7e-43e7-4fa1-9374-ac24915163b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea8e4a395c046c6af2faee055ac3633, user_id=e8cc271d84a247cebe7f6781a4b61330, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:59.253126 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498db7e-43e7-4fa1-9374-ac24915163b0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:59.266987 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1222/2444] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:15:59 2021] PUT /identity/v3/projects/8ea8e4a395c046c6af2faee055ac3633/users/e8cc271d84a247cebe7f6781a4b61330/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:59.277022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8c8ab-c109-45b2-b5dd-08261a00f1d7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.277507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8c8ab-c109-45b2-b5dd-08261a00f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.277860 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8c8ab-c109-45b2-b5dd-08261a00f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.316406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7db8c8ab-c109-45b2-b5dd-08261a00f1d7 None None] MFA Rules not processed for user `e8cc271d84a247cebe7f6781a4b61330`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:15:59.317705 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7db8c8ab-c109-45b2-b5dd-08261a00f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:15:59.391842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1223/2445] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:15:59 2021] POST /identity/v3/auth/tokens => generated 3716 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:15:59.396568 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498db7e-43e7-4fa1-9374-ac24915163b0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.464389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498db7e-43e7-4fa1-9374-ac24915163b0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:59.469365 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21419a-961c-4f97-922a-4e55d5ee2305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:59.469954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21419a-961c-4f97-922a-4e55d5ee2305 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.470263 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21419a-961c-4f97-922a-4e55d5ee2305 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.470527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21419a-961c-4f97-922a-4e55d5ee2305 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.471189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21419a-961c-4f97-922a-4e55d5ee2305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:59.497933 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21419a-961c-4f97-922a-4e55d5ee2305 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:59.524929 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1223/2446] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:15:59 2021] POST /identity/v3/projects => generated 407 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:15:59.529089 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8c8ab-c109-45b2-b5dd-08261a00f1d7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.541696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8c8ab-c109-45b2-b5dd-08261a00f1d7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:59.609447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25fdb2-a118-44ae-b403-4a5dedeedb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:59.609447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25fdb2-a118-44ae-b403-4a5dedeedb67 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.609817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25fdb2-a118-44ae-b403-4a5dedeedb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.610056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25fdb2-a118-44ae-b403-4a5dedeedb67 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.611013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25fdb2-a118-44ae-b403-4a5dedeedb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:59.636310 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25fdb2-a118-44ae-b403-4a5dedeedb67 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:59.657170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1224/2447] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:15:59 2021] POST /identity/v3/users => generated 310 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:15:59.661174 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21419a-961c-4f97-922a-4e55d5ee2305 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.671659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21419a-961c-4f97-922a-4e55d5ee2305 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:59.676037 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dd9c2-82db-460d-ada1-11def2c08494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:59.676629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd9c2-82db-460d-ada1-11def2c08494 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.676920 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd9c2-82db-460d-ada1-11def2c08494 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.677208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dd9c2-82db-460d-ada1-11def2c08494 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.677891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dd9c2-82db-460d-ada1-11def2c08494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:59.703852 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dd9c2-82db-460d-ada1-11def2c08494 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:59.714946 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1224/2448] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:15:59.719214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25fdb2-a118-44ae-b403-4a5dedeedb67 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.728662 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25fdb2-a118-44ae-b403-4a5dedeedb67 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:59.732919 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a648-d585-4fbe-bcd3-2909f0b3732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:59.734232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a648-d585-4fbe-bcd3-2909f0b3732c admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.734519 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a648-d585-4fbe-bcd3-2909f0b3732c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.734823 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a648-d585-4fbe-bcd3-2909f0b3732c admin admin] PATH_INFO: `/v3/projects/210fd9c9ec7a4cbe91f4859ec8eef8cb/users/4dc536de5870426b9788235d3e68492f/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.755931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a648-d585-4fbe-bcd3-2909f0b3732c admin admin] RBAC: Authorizing `identity:create_grant(project_id=210fd9c9ec7a4cbe91f4859ec8eef8cb, user_id=4dc536de5870426b9788235d3e68492f, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:59.781987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a648-d585-4fbe-bcd3-2909f0b3732c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:59.794575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1225/2449] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:15:59 2021] PUT /identity/v3/projects/210fd9c9ec7a4cbe91f4859ec8eef8cb/users/4dc536de5870426b9788235d3e68492f/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:59.799164 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dd9c2-82db-460d-ada1-11def2c08494 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.809363 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dd9c2-82db-460d-ada1-11def2c08494 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:59.878722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b676f-1b9b-4c1a-8496-f1405f23a4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:59.879329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b676f-1b9b-4c1a-8496-f1405f23a4ef admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.879625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b676f-1b9b-4c1a-8496-f1405f23a4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.879910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b676f-1b9b-4c1a-8496-f1405f23a4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.880601 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b676f-1b9b-4c1a-8496-f1405f23a4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:59.906274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b676f-1b9b-4c1a-8496-f1405f23a4ef admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:59.916625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1225/2450] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:15:59.921390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a648-d585-4fbe-bcd3-2909f0b3732c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.931239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a648-d585-4fbe-bcd3-2909f0b3732c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:15:59.935451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e69f9-8913-403f-9fb7-8f65d5740376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:15:59.936265 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e69f9-8913-403f-9fb7-8f65d5740376 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:15:59.936585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e69f9-8913-403f-9fb7-8f65d5740376 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:15:59.936931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e69f9-8913-403f-9fb7-8f65d5740376 admin admin] PATH_INFO: `/v3/projects/210fd9c9ec7a4cbe91f4859ec8eef8cb/users/4dc536de5870426b9788235d3e68492f/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:15:59.938755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e69f9-8913-403f-9fb7-8f65d5740376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210fd9c9ec7a4cbe91f4859ec8eef8cb, user_id=4dc536de5870426b9788235d3e68492f, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:15:59.964764 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e69f9-8913-403f-9fb7-8f65d5740376 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:15:59.976369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1226/2451] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:15:59 2021] PUT /identity/v3/projects/210fd9c9ec7a4cbe91f4859ec8eef8cb/users/4dc536de5870426b9788235d3e68492f/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:15:59.980486 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b676f-1b9b-4c1a-8496-f1405f23a4ef admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:15:59.990892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b676f-1b9b-4c1a-8496-f1405f23a4ef admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:00.057661 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419efa-de48-47a1-b460-117127f1fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:00.058272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419efa-de48-47a1-b460-117127f1fef7 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:00.058559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419efa-de48-47a1-b460-117127f1fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:00.058939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419efa-de48-47a1-b460-117127f1fef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:00.059629 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419efa-de48-47a1-b460-117127f1fef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:00.085250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419efa-de48-47a1-b460-117127f1fef7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:00.096307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1226/2452] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:16:00.100487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e69f9-8913-403f-9fb7-8f65d5740376 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:00.111535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e69f9-8913-403f-9fb7-8f65d5740376 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:00.115741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f12d7-cc21-41c8-9144-0821903b33c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:00.116542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f12d7-cc21-41c8-9144-0821903b33c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:00.116831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f12d7-cc21-41c8-9144-0821903b33c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:00.117113 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f12d7-cc21-41c8-9144-0821903b33c3 admin admin] PATH_INFO: `/v3/projects/210fd9c9ec7a4cbe91f4859ec8eef8cb/users/4dc536de5870426b9788235d3e68492f/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:00.118850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f12d7-cc21-41c8-9144-0821903b33c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210fd9c9ec7a4cbe91f4859ec8eef8cb, user_id=4dc536de5870426b9788235d3e68492f, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:00.147181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f12d7-cc21-41c8-9144-0821903b33c3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:00.162449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1227/2453] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:00 2021] PUT /identity/v3/projects/210fd9c9ec7a4cbe91f4859ec8eef8cb/users/4dc536de5870426b9788235d3e68492f/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:00.174249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7d7fc-33a9-48d4-9298-564c8beba61a None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:00.174575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7d7fc-33a9-48d4-9298-564c8beba61a None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:00.174889 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7d7fc-33a9-48d4-9298-564c8beba61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:00.209988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-50f7d7fc-33a9-48d4-9298-564c8beba61a None None] MFA Rules not processed for user `4dc536de5870426b9788235d3e68492f`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:00.211171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-50f7d7fc-33a9-48d4-9298-564c8beba61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:00.296945 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1227/2454] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:00 2021] POST /identity/v3/auth/tokens => generated 3781 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:00.305912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f12d7-cc21-41c8-9144-0821903b33c3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:00.307715 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e76f12d7-cc21-41c8-9144-0821903b33c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:00.372133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f12d7-cc21-41c8-9144-0821903b33c3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:00.375557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdf6b4-4936-4ed7-a031-95357cba365a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:00.376134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdf6b4-4936-4ed7-a031-95357cba365a service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:00.376422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdf6b4-4936-4ed7-a031-95357cba365a service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:00.376703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdf6b4-4936-4ed7-a031-95357cba365a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:00.385368 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdf6b4-4936-4ed7-a031-95357cba365a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:00.411994 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdf6b4-4936-4ed7-a031-95357cba365a service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:00.423516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1228/2455] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:00 2021] GET /identity/v3/auth/tokens => generated 3781 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:16:00.589385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7d7fc-33a9-48d4-9298-564c8beba61a None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:00.599454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7d7fc-33a9-48d4-9298-564c8beba61a None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:00.602800 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db618cc-5238-4c58-bb32-c05e781bd528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:00.603380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db618cc-5238-4c58-bb32-c05e781bd528 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:00.603673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db618cc-5238-4c58-bb32-c05e781bd528 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:00.603959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db618cc-5238-4c58-bb32-c05e781bd528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:00.684758 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db618cc-5238-4c58-bb32-c05e781bd528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:00.710424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db618cc-5238-4c58-bb32-c05e781bd528 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:00.720162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1228/2456] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:00 2021] GET /identity/v3/auth/tokens => generated 3716 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:16:09.855749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdf6b4-4936-4ed7-a031-95357cba365a service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:09.926365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdf6b4-4936-4ed7-a031-95357cba365a service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:09.930413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:09.931241 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:09.931528 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:09.931810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] PATH_INFO: `/v3/users/e8cc271d84a247cebe7f6781a4b61330` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:09.932877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cc271d84a247cebe7f6781a4b61330)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:09.958851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:10.032396 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cc271d84a247cebe7f6781a4b61330'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.047542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cc271d84a247cebe7f6781a4b61330'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.048283 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cc271d84a247cebe7f6781a4b61330'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.056554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cc271d84a247cebe7f6781a4b61330'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.065110 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cc271d84a247cebe7f6781a4b61330'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.075704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1229/2457] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:16:09 2021] DELETE /identity/v3/users/e8cc271d84a247cebe7f6781a4b61330 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:10.077866 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a87e9-efb9-40e4-9acb-925fcac78595 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:10.078468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a87e9-efb9-40e4-9acb-925fcac78595 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:10.078468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a87e9-efb9-40e4-9acb-925fcac78595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:10.104453 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-499a87e9-efb9-40e4-9acb-925fcac78595 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:10.105604 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-499a87e9-efb9-40e4-9acb-925fcac78595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:10.179905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1229/2458] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:16:10.190447 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:10.191835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:10.257794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b76b04-ec6b-4aa6-afcf-69b70bfa1510 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:10.261135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1026a3c-6872-49a1-99c1-6864679da2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:10.261716 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1026a3c-6872-49a1-99c1-6864679da2ab service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:10.262012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1026a3c-6872-49a1-99c1-6864679da2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:10.262298 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1026a3c-6872-49a1-99c1-6864679da2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:10.271863 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1026a3c-6872-49a1-99c1-6864679da2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:10.297451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1026a3c-6872-49a1-99c1-6864679da2ab service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:10.306585 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1230/2459] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:16:10.739659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a87e9-efb9-40e4-9acb-925fcac78595 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:10.743153 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-499a87e9-efb9-40e4-9acb-925fcac78595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:10.758960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a87e9-efb9-40e4-9acb-925fcac78595 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:10.779587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:10.781189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:10.781891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:10.781891 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] PATH_INFO: `/v3/projects/8ea8e4a395c046c6af2faee055ac3633` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:10.783939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea8e4a395c046c6af2faee055ac3633)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:10.811374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:10.865188 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea8e4a395c046c6af2faee055ac3633', 'request_id': 'req-496e4af9-f645-43b3-b6d4-c3f2119096e4'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.876132 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea8e4a395c046c6af2faee055ac3633', 'request_id': 'req-496e4af9-f645-43b3-b6d4-c3f2119096e4'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.883194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea8e4a395c046c6af2faee055ac3633', 'request_id': 'req-496e4af9-f645-43b3-b6d4-c3f2119096e4'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.893691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] The token cache is being invalidate because project 8ea8e4a395c046c6af2faee055ac3633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:16:10.893976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.894561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:10.896014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1230/2460] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:16:10 2021] DELETE /identity/v3/projects/8ea8e4a395c046c6af2faee055ac3633 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:10.900193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1026a3c-6872-49a1-99c1-6864679da2ab service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:10.910209 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1026a3c-6872-49a1-99c1-6864679da2ab service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:10.974028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:10.975002 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:10.975293 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:10.975579 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] PATH_INFO: `/v3/users/4dc536de5870426b9788235d3e68492f` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:10.976677 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc536de5870426b9788235d3e68492f)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:11.002527 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:11.056718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc536de5870426b9788235d3e68492f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.069045 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc536de5870426b9788235d3e68492f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.069730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc536de5870426b9788235d3e68492f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.077881 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc536de5870426b9788235d3e68492f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.084927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-d4ff24cb-e42b-48fb-b710-473976a4e2ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc536de5870426b9788235d3e68492f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.092193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1231/2461] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:16:10 2021] DELETE /identity/v3/users/4dc536de5870426b9788235d3e68492f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:16:11.466835 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:11.468344 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:11.480564 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e4af9-f645-43b3-b6d4-c3f2119096e4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:11.546150 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:11.547082 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:11.547367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:11.547646 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] PATH_INFO: `/v3/projects/210fd9c9ec7a4cbe91f4859ec8eef8cb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:11.548755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210fd9c9ec7a4cbe91f4859ec8eef8cb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:11.576851 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:11.626547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210fd9c9ec7a4cbe91f4859ec8eef8cb', 'request_id': 'req-483045af-fe54-4e18-9dda-68de4a436cb8'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.637855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210fd9c9ec7a4cbe91f4859ec8eef8cb', 'request_id': 'req-483045af-fe54-4e18-9dda-68de4a436cb8'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.645433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210fd9c9ec7a4cbe91f4859ec8eef8cb', 'request_id': 'req-483045af-fe54-4e18-9dda-68de4a436cb8'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.655337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] The token cache is being invalidate because project 210fd9c9ec7a4cbe91f4859ec8eef8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:16:11.655677 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.656266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-483045af-fe54-4e18-9dda-68de4a436cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:11.657669 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1231/2462] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:16:11 2021] DELETE /identity/v3/projects/210fd9c9ec7a4cbe91f4859ec8eef8cb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:11.665198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e3017-bb5d-45c4-a2dc-2b4693f73f91 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:11.665489 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e3017-bb5d-45c4-a2dc-2b4693f73f91 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:11.665773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e3017-bb5d-45c4-a2dc-2b4693f73f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:11.688607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b03e3017-bb5d-45c4-a2dc-2b4693f73f91 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:11.689741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b03e3017-bb5d-45c4-a2dc-2b4693f73f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:11.754112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1232/2463] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:11.761844 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b959b-c453-4d17-b516-250fdca3eabb None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:11.762143 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b959b-c453-4d17-b516-250fdca3eabb None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:11.762427 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b959b-c453-4d17-b516-250fdca3eabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:11.784676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-799b959b-c453-4d17-b516-250fdca3eabb None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:11.785828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-799b959b-c453-4d17-b516-250fdca3eabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:11.792794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1232/2464] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:11.798682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e3017-bb5d-45c4-a2dc-2b4693f73f91 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:11.808055 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e3017-bb5d-45c4-a2dc-2b4693f73f91 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:11.813289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1260a-e564-48ea-a536-5e96674a11ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:11.813891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1260a-e564-48ea-a536-5e96674a11ea admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:11.814186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1260a-e564-48ea-a536-5e96674a11ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:11.814475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1260a-e564-48ea-a536-5e96674a11ea admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:11.815208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1260a-e564-48ea-a536-5e96674a11ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:16:11.815512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1260a-e564-48ea-a536-5e96674a11ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:11.841415 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1260a-e564-48ea-a536-5e96674a11ea admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:11.860092 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1233/2465] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:16:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:16:11.861444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b959b-c453-4d17-b516-250fdca3eabb None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:11.870411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b959b-c453-4d17-b516-250fdca3eabb None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:11.875416 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f895eb-4c24-4cfb-835f-ad5f15f66919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:11.876018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f895eb-4c24-4cfb-835f-ad5f15f66919 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:11.876309 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f895eb-4c24-4cfb-835f-ad5f15f66919 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:11.876595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f895eb-4c24-4cfb-835f-ad5f15f66919 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:11.877240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f895eb-4c24-4cfb-835f-ad5f15f66919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:11.902905 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f895eb-4c24-4cfb-835f-ad5f15f66919 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:11.931599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1233/2466] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:16:11 2021] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:16:11.935678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1260a-e564-48ea-a536-5e96674a11ea admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:11.945379 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1260a-e564-48ea-a536-5e96674a11ea admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:12.011060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b522b1a-bd6d-4005-a940-ff82f24f3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:12.011672 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b522b1a-bd6d-4005-a940-ff82f24f3c0b admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.011967 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b522b1a-bd6d-4005-a940-ff82f24f3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.012758 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b522b1a-bd6d-4005-a940-ff82f24f3c0b admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.012940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b522b1a-bd6d-4005-a940-ff82f24f3c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:12.039975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b522b1a-bd6d-4005-a940-ff82f24f3c0b admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:12.061395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1234/2467] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:16:11 2021] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:16:12.065607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f895eb-4c24-4cfb-835f-ad5f15f66919 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:12.075419 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f895eb-4c24-4cfb-835f-ad5f15f66919 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:12.079863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9531da-f483-4f79-ae2e-ac4efa4b2bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:12.080452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9531da-f483-4f79-ae2e-ac4efa4b2bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.080743 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9531da-f483-4f79-ae2e-ac4efa4b2bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.081029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9531da-f483-4f79-ae2e-ac4efa4b2bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.081752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9531da-f483-4f79-ae2e-ac4efa4b2bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:12.107746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9531da-f483-4f79-ae2e-ac4efa4b2bc0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:12.119890 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1234/2468] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:16:12 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:16:12.124214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b522b1a-bd6d-4005-a940-ff82f24f3c0b admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:12.134261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b522b1a-bd6d-4005-a940-ff82f24f3c0b admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:12.138564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784ac20-3635-4ffe-9339-ec58f38aa572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:12.139393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784ac20-3635-4ffe-9339-ec58f38aa572 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.139871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784ac20-3635-4ffe-9339-ec58f38aa572 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.140163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784ac20-3635-4ffe-9339-ec58f38aa572 admin admin] PATH_INFO: `/v3/projects/d57dc0d8536d4ae689b12bf023500b16/users/13b841a96bd142648fbb2deb2352c818/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.161278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784ac20-3635-4ffe-9339-ec58f38aa572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57dc0d8536d4ae689b12bf023500b16, user_id=13b841a96bd142648fbb2deb2352c818, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:12.188038 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784ac20-3635-4ffe-9339-ec58f38aa572 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:12.200737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1235/2469] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:12 2021] PUT /identity/v3/projects/d57dc0d8536d4ae689b12bf023500b16/users/13b841a96bd142648fbb2deb2352c818/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:12.211804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd34c-9e8a-4446-b304-96eadeb01d84 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.212303 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd34c-9e8a-4446-b304-96eadeb01d84 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.212598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd34c-9e8a-4446-b304-96eadeb01d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.250189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-527bd34c-9e8a-4446-b304-96eadeb01d84 None None] MFA Rules not processed for user `13b841a96bd142648fbb2deb2352c818`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:12.251371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-527bd34c-9e8a-4446-b304-96eadeb01d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:12.327395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1235/2470] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:12 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:12.331842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784ac20-3635-4ffe-9339-ec58f38aa572 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:12.410115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784ac20-3635-4ffe-9339-ec58f38aa572 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:12.414614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920d661-605e-4a2d-977a-db0f64fe0e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:12.415258 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d661-605e-4a2d-977a-db0f64fe0e00 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.415834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d661-605e-4a2d-977a-db0f64fe0e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.415949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d661-605e-4a2d-977a-db0f64fe0e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.416565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920d661-605e-4a2d-977a-db0f64fe0e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:12.444336 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920d661-605e-4a2d-977a-db0f64fe0e00 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:12.476024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1236/2471] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:16:12 2021] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:16:12.480203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd34c-9e8a-4446-b304-96eadeb01d84 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:12.496003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd34c-9e8a-4446-b304-96eadeb01d84 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:12.564989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a672c-4390-4920-a976-d109dbe5b377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:12.565598 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a672c-4390-4920-a976-d109dbe5b377 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.565886 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a672c-4390-4920-a976-d109dbe5b377 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.566167 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a672c-4390-4920-a976-d109dbe5b377 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.566847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a672c-4390-4920-a976-d109dbe5b377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:12.593399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a672c-4390-4920-a976-d109dbe5b377 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:12.617976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1236/2472] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:16:12 2021] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:16:12.619113 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920d661-605e-4a2d-977a-db0f64fe0e00 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:12.630307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920d661-605e-4a2d-977a-db0f64fe0e00 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:12.635239 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301fb96-bb27-40d0-a4eb-39f794f0a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:12.635842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301fb96-bb27-40d0-a4eb-39f794f0a8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.636133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301fb96-bb27-40d0-a4eb-39f794f0a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.636422 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301fb96-bb27-40d0-a4eb-39f794f0a8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.637163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301fb96-bb27-40d0-a4eb-39f794f0a8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:12.662981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301fb96-bb27-40d0-a4eb-39f794f0a8b3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:12.675197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1237/2473] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:16:12 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:16:12.679553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a672c-4390-4920-a976-d109dbe5b377 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:12.689111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a672c-4390-4920-a976-d109dbe5b377 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:12.693428 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e75a4d-3eaa-4102-be5f-1f25ce78a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:12.694249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75a4d-3eaa-4102-be5f-1f25ce78a7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.694535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75a4d-3eaa-4102-be5f-1f25ce78a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.694855 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75a4d-3eaa-4102-be5f-1f25ce78a7dc admin admin] PATH_INFO: `/v3/projects/74a36224f7774d25bba57c24f1b3d0c3/users/a6c3504b0e8c431fb7c8930cab6ffb9f/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.716324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e75a4d-3eaa-4102-be5f-1f25ce78a7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a36224f7774d25bba57c24f1b3d0c3, user_id=a6c3504b0e8c431fb7c8930cab6ffb9f, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:12.743910 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e75a4d-3eaa-4102-be5f-1f25ce78a7dc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:12.758073 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1237/2474] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:12 2021] PUT /identity/v3/projects/74a36224f7774d25bba57c24f1b3d0c3/users/a6c3504b0e8c431fb7c8930cab6ffb9f/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:12.761965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301fb96-bb27-40d0-a4eb-39f794f0a8b3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:12.771595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301fb96-bb27-40d0-a4eb-39f794f0a8b3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:12.837170 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acabbcb-8a17-4e43-8148-d345f4b6569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:12.837795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acabbcb-8a17-4e43-8148-d345f4b6569a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.838090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acabbcb-8a17-4e43-8148-d345f4b6569a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.838376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acabbcb-8a17-4e43-8148-d345f4b6569a admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.839108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acabbcb-8a17-4e43-8148-d345f4b6569a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:12.865954 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acabbcb-8a17-4e43-8148-d345f4b6569a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:12.876596 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1238/2475] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:16:12 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:16:12.880912 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e75a4d-3eaa-4102-be5f-1f25ce78a7dc admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:12.891014 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e75a4d-3eaa-4102-be5f-1f25ce78a7dc admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:12.895177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c153e-007a-4933-b5ba-7e120f3f27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:12.895985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c153e-007a-4933-b5ba-7e120f3f27d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:12.896273 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c153e-007a-4933-b5ba-7e120f3f27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:12.896557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c153e-007a-4933-b5ba-7e120f3f27d5 admin admin] PATH_INFO: `/v3/projects/74a36224f7774d25bba57c24f1b3d0c3/users/a6c3504b0e8c431fb7c8930cab6ffb9f/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:12.898304 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c153e-007a-4933-b5ba-7e120f3f27d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a36224f7774d25bba57c24f1b3d0c3, user_id=a6c3504b0e8c431fb7c8930cab6ffb9f, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:12.925538 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c153e-007a-4933-b5ba-7e120f3f27d5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:12.935738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1238/2476] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:12 2021] PUT /identity/v3/projects/74a36224f7774d25bba57c24f1b3d0c3/users/a6c3504b0e8c431fb7c8930cab6ffb9f/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:12.940065 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acabbcb-8a17-4e43-8148-d345f4b6569a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:12.949506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acabbcb-8a17-4e43-8148-d345f4b6569a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:13.015025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1282ee-06a8-4a73-94b7-02686e0cf0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:13.015629 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1282ee-06a8-4a73-94b7-02686e0cf0bd admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:13.015927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1282ee-06a8-4a73-94b7-02686e0cf0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:13.016212 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1282ee-06a8-4a73-94b7-02686e0cf0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:13.016906 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1282ee-06a8-4a73-94b7-02686e0cf0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:13.043120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1282ee-06a8-4a73-94b7-02686e0cf0bd admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:13.053829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1239/2477] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:16:12 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:16:13.058016 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c153e-007a-4933-b5ba-7e120f3f27d5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:13.068146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c153e-007a-4933-b5ba-7e120f3f27d5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:13.072279 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da679133-265a-44c5-a007-cdc772eb062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:13.073092 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da679133-265a-44c5-a007-cdc772eb062f admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:13.073398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da679133-265a-44c5-a007-cdc772eb062f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:13.073668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da679133-265a-44c5-a007-cdc772eb062f admin admin] PATH_INFO: `/v3/projects/74a36224f7774d25bba57c24f1b3d0c3/users/a6c3504b0e8c431fb7c8930cab6ffb9f/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:13.075479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da679133-265a-44c5-a007-cdc772eb062f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a36224f7774d25bba57c24f1b3d0c3, user_id=a6c3504b0e8c431fb7c8930cab6ffb9f, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:13.103168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da679133-265a-44c5-a007-cdc772eb062f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:13.117778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1239/2478] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:13 2021] PUT /identity/v3/projects/74a36224f7774d25bba57c24f1b3d0c3/users/a6c3504b0e8c431fb7c8930cab6ffb9f/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:13.127789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b610041-fd6e-40a5-b43e-8fefd8071ef7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:13.128017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b610041-fd6e-40a5-b43e-8fefd8071ef7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:13.128312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b610041-fd6e-40a5-b43e-8fefd8071ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:13.169624 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-4b610041-fd6e-40a5-b43e-8fefd8071ef7 None None] MFA Rules not processed for user `a6c3504b0e8c431fb7c8930cab6ffb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:13.170820 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-4b610041-fd6e-40a5-b43e-8fefd8071ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:13.247736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1240/2479] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:13 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:13.257285 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da679133-265a-44c5-a007-cdc772eb062f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:13.259139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-da679133-265a-44c5-a007-cdc772eb062f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:13.324025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da679133-265a-44c5-a007-cdc772eb062f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:13.328108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17028cda-51ef-406d-a4f8-558205872aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:13.328685 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17028cda-51ef-406d-a4f8-558205872aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:13.328970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17028cda-51ef-406d-a4f8-558205872aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:13.329249 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17028cda-51ef-406d-a4f8-558205872aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:13.392508 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17028cda-51ef-406d-a4f8-558205872aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:13.417266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17028cda-51ef-406d-a4f8-558205872aa0 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:13.426443 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1240/2480] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:13 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:16:19.604405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b610041-fd6e-40a5-b43e-8fefd8071ef7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:19.689644 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b610041-fd6e-40a5-b43e-8fefd8071ef7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:19.693713 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:19.694511 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:19.694824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:19.695107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] PATH_INFO: `/v3/users/13b841a96bd142648fbb2deb2352c818` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:19.696261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b841a96bd142648fbb2deb2352c818)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:19.722595 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:19.777517 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b841a96bd142648fbb2deb2352c818'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:19.790003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b841a96bd142648fbb2deb2352c818'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:19.790741 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b841a96bd142648fbb2deb2352c818'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:19.798655 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b841a96bd142648fbb2deb2352c818'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:19.808921 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b841a96bd142648fbb2deb2352c818'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:19.815534 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1241/2481] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:16:19 2021] DELETE /identity/v3/users/13b841a96bd142648fbb2deb2352c818 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:19.820179 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765dc55-666e-42af-ab0b-e35d1f282cf0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:19.820713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765dc55-666e-42af-ab0b-e35d1f282cf0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:19.820821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765dc55-666e-42af-ab0b-e35d1f282cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:19.843914 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7765dc55-666e-42af-ab0b-e35d1f282cf0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:19.845163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7765dc55-666e-42af-ab0b-e35d1f282cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:19.912224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1241/2482] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:19.923037 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:19.924557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:19.996030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e82c-111b-46b4-aa11-e6defb0df118 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:19.999662 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd8a63-846d-4cb3-b58b-868062c283fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:20.000315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8a63-846d-4cb3-b58b-868062c283fe service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:20.000676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8a63-846d-4cb3-b58b-868062c283fe service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:20.001029 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8a63-846d-4cb3-b58b-868062c283fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:20.010755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd8a63-846d-4cb3-b58b-868062c283fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:20.037586 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd8a63-846d-4cb3-b58b-868062c283fe service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:20.048581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1242/2483] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:16:20.500710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765dc55-666e-42af-ab0b-e35d1f282cf0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:20.502295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7765dc55-666e-42af-ab0b-e35d1f282cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:20.513517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765dc55-666e-42af-ab0b-e35d1f282cf0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:20.518581 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:20.519474 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:20.519681 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:20.519964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] PATH_INFO: `/v3/projects/d57dc0d8536d4ae689b12bf023500b16` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:20.521043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57dc0d8536d4ae689b12bf023500b16)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:20.546930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:20.596146 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57dc0d8536d4ae689b12bf023500b16', 'request_id': 'req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.606834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57dc0d8536d4ae689b12bf023500b16', 'request_id': 'req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.614903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57dc0d8536d4ae689b12bf023500b16', 'request_id': 'req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.625847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] The token cache is being invalidate because project d57dc0d8536d4ae689b12bf023500b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:16:20.626527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.626881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.628324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1242/2484] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:16:20 2021] DELETE /identity/v3/projects/d57dc0d8536d4ae689b12bf023500b16 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:20.632624 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd8a63-846d-4cb3-b58b-868062c283fe service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:20.642301 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd8a63-846d-4cb3-b58b-868062c283fe service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:20.709164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:20.709993 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:20.710281 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:20.710562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] PATH_INFO: `/v3/users/a6c3504b0e8c431fb7c8930cab6ffb9f` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:20.711670 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c3504b0e8c431fb7c8930cab6ffb9f)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:20.738827 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:20.789846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c3504b0e8c431fb7c8930cab6ffb9f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.802917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c3504b0e8c431fb7c8930cab6ffb9f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.803664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c3504b0e8c431fb7c8930cab6ffb9f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.811981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c3504b0e8c431fb7c8930cab6ffb9f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.820591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e9efd846-a9cc-48db-9217-52abbdc45989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c3504b0e8c431fb7c8930cab6ffb9f'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:20.827243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1243/2485] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:16:20 2021] DELETE /identity/v3/users/a6c3504b0e8c431fb7c8930cab6ffb9f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:21.185145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:21.186541 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:21.199385 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2765a5-5e8e-462a-8f3c-c48a7b992a35 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:21.270319 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:21.271194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:21.271437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:21.271722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] PATH_INFO: `/v3/projects/74a36224f7774d25bba57c24f1b3d0c3` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:21.272796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a36224f7774d25bba57c24f1b3d0c3)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:21.299108 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:21.355084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a36224f7774d25bba57c24f1b3d0c3', 'request_id': 'req-d7c34604-1640-4599-869c-5f45a4f995f7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:21.367479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a36224f7774d25bba57c24f1b3d0c3', 'request_id': 'req-d7c34604-1640-4599-869c-5f45a4f995f7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:21.375667 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a36224f7774d25bba57c24f1b3d0c3', 'request_id': 'req-d7c34604-1640-4599-869c-5f45a4f995f7'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:21.385717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] The token cache is being invalidate because project 74a36224f7774d25bba57c24f1b3d0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:16:21.386081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:21.386785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d7c34604-1640-4599-869c-5f45a4f995f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:21.388284 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1243/2486] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:16:21 2021] DELETE /identity/v3/projects/74a36224f7774d25bba57c24f1b3d0c3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:21.394676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dca413-34fd-4feb-8e11-abb41c6f0504 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:21.395223 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dca413-34fd-4feb-8e11-abb41c6f0504 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:21.395513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dca413-34fd-4feb-8e11-abb41c6f0504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:21.417678 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-f7dca413-34fd-4feb-8e11-abb41c6f0504 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:21.419551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-f7dca413-34fd-4feb-8e11-abb41c6f0504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:21.489938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1244/2487] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:21.497715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292e9b3-c888-446b-a56c-2ab922b1e1b7 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:21.498015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292e9b3-c888-446b-a56c-2ab922b1e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:21.498306 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292e9b3-c888-446b-a56c-2ab922b1e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:21.521992 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2292e9b3-c888-446b-a56c-2ab922b1e1b7 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:21.523145 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2292e9b3-c888-446b-a56c-2ab922b1e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:21.533934 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1244/2488] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:21.535252 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dca413-34fd-4feb-8e11-abb41c6f0504 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:21.545210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dca413-34fd-4feb-8e11-abb41c6f0504 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:21.550086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da31f5-c7c0-4160-af01-a1eabaff8355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:21.550723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da31f5-c7c0-4160-af01-a1eabaff8355 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:21.551021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da31f5-c7c0-4160-af01-a1eabaff8355 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:21.551311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da31f5-c7c0-4160-af01-a1eabaff8355 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:21.552001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da31f5-c7c0-4160-af01-a1eabaff8355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:16:21.552676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da31f5-c7c0-4160-af01-a1eabaff8355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:21.579144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da31f5-c7c0-4160-af01-a1eabaff8355 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:21.594317 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1245/2489] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:16:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:16:21.599459 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292e9b3-c888-446b-a56c-2ab922b1e1b7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:21.610887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292e9b3-c888-446b-a56c-2ab922b1e1b7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:21.617791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff09e4e-8dbd-423b-b838-b9e8c3750dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:21.618468 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09e4e-8dbd-423b-b838-b9e8c3750dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:21.618858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09e4e-8dbd-423b-b838-b9e8c3750dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:21.619217 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09e4e-8dbd-423b-b838-b9e8c3750dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:21.620089 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09e4e-8dbd-423b-b838-b9e8c3750dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:21.646250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09e4e-8dbd-423b-b838-b9e8c3750dd1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:21.684171 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1245/2490] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:16:21 2021] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:16:21.685388 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da31f5-c7c0-4160-af01-a1eabaff8355 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:21.695417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da31f5-c7c0-4160-af01-a1eabaff8355 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:21.760949 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e99ca4-3212-4d52-803f-8ed2f956b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:21.761558 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e99ca4-3212-4d52-803f-8ed2f956b2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:21.761884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e99ca4-3212-4d52-803f-8ed2f956b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:21.762132 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e99ca4-3212-4d52-803f-8ed2f956b2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:21.762858 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e99ca4-3212-4d52-803f-8ed2f956b2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:21.789013 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e99ca4-3212-4d52-803f-8ed2f956b2f9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:21.814946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1246/2491] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:16:21 2021] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:16:21.816237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff09e4e-8dbd-423b-b838-b9e8c3750dd1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:21.826644 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff09e4e-8dbd-423b-b838-b9e8c3750dd1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:21.831829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7d066-f66e-4eb5-80cc-4a3d25be6532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:21.832447 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d066-f66e-4eb5-80cc-4a3d25be6532 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:21.832737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d066-f66e-4eb5-80cc-4a3d25be6532 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:21.833022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d066-f66e-4eb5-80cc-4a3d25be6532 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:21.833754 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7d066-f66e-4eb5-80cc-4a3d25be6532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:21.859430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7d066-f66e-4eb5-80cc-4a3d25be6532 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:21.874127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1246/2492] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:16:21.875982 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e99ca4-3212-4d52-803f-8ed2f956b2f9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:21.889338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e99ca4-3212-4d52-803f-8ed2f956b2f9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:21.894912 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e83e-408c-464a-8bd5-b653ebe02104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:21.896036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e83e-408c-464a-8bd5-b653ebe02104 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:21.896877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e83e-408c-464a-8bd5-b653ebe02104 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:21.898350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e83e-408c-464a-8bd5-b653ebe02104 admin admin] PATH_INFO: `/v3/projects/d5ec3a710c9f4776b3b99cfa07e54f33/users/a5782b1c7921431fae931bda425d8ec2/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:21.923259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3e83e-408c-464a-8bd5-b653ebe02104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ec3a710c9f4776b3b99cfa07e54f33, user_id=a5782b1c7921431fae931bda425d8ec2, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:21.954290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3e83e-408c-464a-8bd5-b653ebe02104 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:21.971140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1247/2493] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:21 2021] PUT /identity/v3/projects/d5ec3a710c9f4776b3b99cfa07e54f33/users/a5782b1c7921431fae931bda425d8ec2/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:21.982083 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947e216-b987-4bee-ab43-27738096b67f None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:21.982383 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947e216-b987-4bee-ab43-27738096b67f None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:21.982686 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947e216-b987-4bee-ab43-27738096b67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:22.028107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-d947e216-b987-4bee-ab43-27738096b67f None None] MFA Rules not processed for user `a5782b1c7921431fae931bda425d8ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:22.029546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d947e216-b987-4bee-ab43-27738096b67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:22.108971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1247/2494] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:21 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:22.119697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e83e-408c-464a-8bd5-b653ebe02104 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:22.121328 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-06c3e83e-408c-464a-8bd5-b653ebe02104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:22.187662 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e83e-408c-464a-8bd5-b653ebe02104 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:22.191064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbcc43-1ffd-49fb-9dd3-c641daf2b6a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:22.191727 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbcc43-1ffd-49fb-9dd3-c641daf2b6a8 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:22.191932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbcc43-1ffd-49fb-9dd3-c641daf2b6a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:22.192213 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbcc43-1ffd-49fb-9dd3-c641daf2b6a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:22.200297 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbcc43-1ffd-49fb-9dd3-c641daf2b6a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:22.226689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbcc43-1ffd-49fb-9dd3-c641daf2b6a8 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:22.235718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1248/2495] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:22 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:16:22.258757 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947e216-b987-4bee-ab43-27738096b67f None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:22.326522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947e216-b987-4bee-ab43-27738096b67f None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:22.331548 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:22.332345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:22.332667 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:22.333045 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] PATH_INFO: `/v3/users/a5782b1c7921431fae931bda425d8ec2` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:22.334018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5782b1c7921431fae931bda425d8ec2)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:22.359642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:22.408574 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5782b1c7921431fae931bda425d8ec2'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:22.420439 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5782b1c7921431fae931bda425d8ec2'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:22.421504 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5782b1c7921431fae931bda425d8ec2'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:22.429788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5782b1c7921431fae931bda425d8ec2'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:22.437620 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5782b1c7921431fae931bda425d8ec2'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:22.443567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1248/2496] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:16:22 2021] DELETE /identity/v3/users/a5782b1c7921431fae931bda425d8ec2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:22.447981 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb1812-1122-49f2-b727-726f60613ce4 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:22.448278 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb1812-1122-49f2-b727-726f60613ce4 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:22.448563 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb1812-1122-49f2-b727-726f60613ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:22.475118 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b0cb1812-1122-49f2-b727-726f60613ce4 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:22.476264 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b0cb1812-1122-49f2-b727-726f60613ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:22.539312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1249/2497] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:22.549887 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:22.551237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:22.615424 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d05fe9-9355-4f7d-b803-5c6508513685 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:22.618755 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe741e-cbe5-4e55-a3d3-288e8c505a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:22.619337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe741e-cbe5-4e55-a3d3-288e8c505a90 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:22.619625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe741e-cbe5-4e55-a3d3-288e8c505a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:22.619903 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe741e-cbe5-4e55-a3d3-288e8c505a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:22.628585 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe741e-cbe5-4e55-a3d3-288e8c505a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:22.653200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe741e-cbe5-4e55-a3d3-288e8c505a90 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:22.662655 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1249/2498] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:16:23.029154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb1812-1122-49f2-b727-726f60613ce4 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:23.037075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b0cb1812-1122-49f2-b727-726f60613ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:23.051182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb1812-1122-49f2-b727-726f60613ce4 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:23.063556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:23.064365 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.064658 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.064945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] PATH_INFO: `/v3/projects/d5ec3a710c9f4776b3b99cfa07e54f33` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.066023 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ec3a710c9f4776b3b99cfa07e54f33)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:23.096076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:23.146692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ec3a710c9f4776b3b99cfa07e54f33', 'request_id': 'req-9637a43a-b27f-443f-b0cf-50426e6c2ce9'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:23.158232 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ec3a710c9f4776b3b99cfa07e54f33', 'request_id': 'req-9637a43a-b27f-443f-b0cf-50426e6c2ce9'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:23.165388 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ec3a710c9f4776b3b99cfa07e54f33', 'request_id': 'req-9637a43a-b27f-443f-b0cf-50426e6c2ce9'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:23.176608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] The token cache is being invalidate because project d5ec3a710c9f4776b3b99cfa07e54f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:16:23.176897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:23.177512 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-9637a43a-b27f-443f-b0cf-50426e6c2ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:23.178957 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1250/2499] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:16:23 2021] DELETE /identity/v3/projects/d5ec3a710c9f4776b3b99cfa07e54f33 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:23.184600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b3337-77af-48bc-a020-88cb4d03ce30 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.185000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b3337-77af-48bc-a020-88cb4d03ce30 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.185291 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b3337-77af-48bc-a020-88cb4d03ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.207804 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-a21b3337-77af-48bc-a020-88cb4d03ce30 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:23.208954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a21b3337-77af-48bc-a020-88cb4d03ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:23.281082 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1250/2500] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:23.289008 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94022b7-b5a3-4a64-b2bb-8476cce053a8 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.289369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94022b7-b5a3-4a64-b2bb-8476cce053a8 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.289738 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94022b7-b5a3-4a64-b2bb-8476cce053a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.312862 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-e94022b7-b5a3-4a64-b2bb-8476cce053a8 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:23.314114 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e94022b7-b5a3-4a64-b2bb-8476cce053a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:23.321217 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1251/2501] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:23.325398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b3337-77af-48bc-a020-88cb4d03ce30 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:23.335396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b3337-77af-48bc-a020-88cb4d03ce30 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:23.340130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437d713-624b-4c64-903c-98fb954318a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:23.340730 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437d713-624b-4c64-903c-98fb954318a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.341075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437d713-624b-4c64-903c-98fb954318a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.341313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437d713-624b-4c64-903c-98fb954318a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.342009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437d713-624b-4c64-903c-98fb954318a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:16:23.342310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437d713-624b-4c64-903c-98fb954318a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:23.368732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437d713-624b-4c64-903c-98fb954318a8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:23.385664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1251/2502] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:16:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:16:23.386853 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94022b7-b5a3-4a64-b2bb-8476cce053a8 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:23.395995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94022b7-b5a3-4a64-b2bb-8476cce053a8 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:23.400457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3d6da-f79b-4666-9f2c-b0ab5866c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:23.401027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3d6da-f79b-4666-9f2c-b0ab5866c886 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.401312 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3d6da-f79b-4666-9f2c-b0ab5866c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.401590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3d6da-f79b-4666-9f2c-b0ab5866c886 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.402222 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3d6da-f79b-4666-9f2c-b0ab5866c886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:23.429147 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3d6da-f79b-4666-9f2c-b0ab5866c886 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:23.455850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1252/2503] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:16:23 2021] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:16:23.460199 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437d713-624b-4c64-903c-98fb954318a8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:23.470218 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437d713-624b-4c64-903c-98fb954318a8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:23.530289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54efd69-afa7-492f-8850-645e80d90759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:23.531522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54efd69-afa7-492f-8850-645e80d90759 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.531969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54efd69-afa7-492f-8850-645e80d90759 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.532253 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54efd69-afa7-492f-8850-645e80d90759 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.532881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54efd69-afa7-492f-8850-645e80d90759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:23.558717 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54efd69-afa7-492f-8850-645e80d90759 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:23.577208 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1252/2504] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:16:23 2021] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:16:23.581905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3d6da-f79b-4666-9f2c-b0ab5866c886 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:23.592731 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3d6da-f79b-4666-9f2c-b0ab5866c886 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:23.597692 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e1727-76d2-4bbf-a8aa-0053fa4b8098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:23.598282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e1727-76d2-4bbf-a8aa-0053fa4b8098 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.598573 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e1727-76d2-4bbf-a8aa-0053fa4b8098 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.598900 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e1727-76d2-4bbf-a8aa-0053fa4b8098 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.599591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e1727-76d2-4bbf-a8aa-0053fa4b8098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:23.625269 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e1727-76d2-4bbf-a8aa-0053fa4b8098 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:23.635603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1253/2505] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:16:23 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:16:23.639715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54efd69-afa7-492f-8850-645e80d90759 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:23.650022 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54efd69-afa7-492f-8850-645e80d90759 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:23.654239 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ddfea-951e-4df9-8f21-f81f68788da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:23.655085 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ddfea-951e-4df9-8f21-f81f68788da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.655373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ddfea-951e-4df9-8f21-f81f68788da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.656446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ddfea-951e-4df9-8f21-f81f68788da5 admin admin] PATH_INFO: `/v3/projects/aaa8c6a1d9f04b8aa940a26076686eab/users/41e0b26101294f8297066407a380c700/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.681257 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ddfea-951e-4df9-8f21-f81f68788da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa8c6a1d9f04b8aa940a26076686eab, user_id=41e0b26101294f8297066407a380c700, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:23.707948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ddfea-951e-4df9-8f21-f81f68788da5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:23.720676 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1253/2506] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:23 2021] PUT /identity/v3/projects/aaa8c6a1d9f04b8aa940a26076686eab/users/41e0b26101294f8297066407a380c700/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:23.725637 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b124f-ef67-48f9-aec1-4a97039aa519 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.725960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b124f-ef67-48f9-aec1-4a97039aa519 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.726248 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b124f-ef67-48f9-aec1-4a97039aa519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.748777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-525b124f-ef67-48f9-aec1-4a97039aa519 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:23.751046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-525b124f-ef67-48f9-aec1-4a97039aa519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:23.820437 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1254/2507] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:23.828941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ddfea-951e-4df9-8f21-f81f68788da5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:23.830563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0d8ddfea-951e-4df9-8f21-f81f68788da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:23.906864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ddfea-951e-4df9-8f21-f81f68788da5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:23.910740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d43485-9068-4f10-a43b-e9113a9dfdb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:23.911350 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d43485-9068-4f10-a43b-e9113a9dfdb5 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:23.911636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d43485-9068-4f10-a43b-e9113a9dfdb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:23.911920 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d43485-9068-4f10-a43b-e9113a9dfdb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:23.923513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d43485-9068-4f10-a43b-e9113a9dfdb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:23.949357 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d43485-9068-4f10-a43b-e9113a9dfdb5 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:23.961862 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1254/2508] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:16:31.622617 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b124f-ef67-48f9-aec1-4a97039aa519 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:31.624025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-525b124f-ef67-48f9-aec1-4a97039aa519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:31.635449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b124f-ef67-48f9-aec1-4a97039aa519 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:31.640811 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:31.641633 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:31.641929 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:31.642267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] PATH_INFO: `/v3/users/e5a0fed75e1e4605aa9a470b9a65e271` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:31.643663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a0fed75e1e4605aa9a470b9a65e271)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:31.670682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:31.722649 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a0fed75e1e4605aa9a470b9a65e271'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:31.735366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a0fed75e1e4605aa9a470b9a65e271'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:31.736102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a0fed75e1e4605aa9a470b9a65e271'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:31.745698 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a0fed75e1e4605aa9a470b9a65e271'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:31.755524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a0fed75e1e4605aa9a470b9a65e271'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:31.762261 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1255/2509] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:16:31 2021] DELETE /identity/v3/users/e5a0fed75e1e4605aa9a470b9a65e271 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:31.767163 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b59df0-11a1-496a-8d9a-06a35109626d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:31.767637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b59df0-11a1-496a-8d9a-06a35109626d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:31.767752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b59df0-11a1-496a-8d9a-06a35109626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:31.796449 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-01b59df0-11a1-496a-8d9a-06a35109626d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:31.797557 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-01b59df0-11a1-496a-8d9a-06a35109626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:31.881026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1255/2510] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:16:31.911500 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:31.913401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:32.018850 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353ab7e-ab3b-4b5b-81c2-a32bd2216476 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:32.022412 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec0f31-7d35-4fed-b8b7-37f7126fb2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:32.023053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0f31-7d35-4fed-b8b7-37f7126fb2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:32.023346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0f31-7d35-4fed-b8b7-37f7126fb2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:32.024848 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0f31-7d35-4fed-b8b7-37f7126fb2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:32.035994 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec0f31-7d35-4fed-b8b7-37f7126fb2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:32.068369 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec0f31-7d35-4fed-b8b7-37f7126fb2f6 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:32.082145 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1256/2511] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:16:32.654993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b59df0-11a1-496a-8d9a-06a35109626d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:32.657131 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-01b59df0-11a1-496a-8d9a-06a35109626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:32.668247 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b59df0-11a1-496a-8d9a-06a35109626d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:32.673949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:32.674776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:32.675067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:32.675347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] PATH_INFO: `/v3/projects/b050c3e6f12d48f98e0c47c117d8c270` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:32.676460 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b050c3e6f12d48f98e0c47c117d8c270)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:32.701904 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:32.754610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b050c3e6f12d48f98e0c47c117d8c270', 'request_id': 'req-683771f8-fea7-417f-9a22-eb8be220c60e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:32.768305 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b050c3e6f12d48f98e0c47c117d8c270', 'request_id': 'req-683771f8-fea7-417f-9a22-eb8be220c60e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:32.777028 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b050c3e6f12d48f98e0c47c117d8c270', 'request_id': 'req-683771f8-fea7-417f-9a22-eb8be220c60e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:32.790088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] The token cache is being invalidate because project b050c3e6f12d48f98e0c47c117d8c270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:16:32.790378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:32.791289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:32.794710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1256/2512] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:16:32 2021] DELETE /identity/v3/projects/b050c3e6f12d48f98e0c47c117d8c270 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:33.188332 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef7230-5aca-40c7-af91-ba13e57734b2 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:33.188931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef7230-5aca-40c7-af91-ba13e57734b2 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:33.188931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef7230-5aca-40c7-af91-ba13e57734b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:33.225460 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-90ef7230-5aca-40c7-af91-ba13e57734b2 None None] MFA Rules not processed for user `41e0b26101294f8297066407a380c700`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:33.226612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-90ef7230-5aca-40c7-af91-ba13e57734b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:33.303333 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1257/2513] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:33 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:33.307700 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:33.309420 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:33.380135 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683771f8-fea7-417f-9a22-eb8be220c60e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:33.384504 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03651a-7099-4f05-b8db-c25d34c220e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:33.385272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03651a-7099-4f05-b8db-c25d34c220e1 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:33.385560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03651a-7099-4f05-b8db-c25d34c220e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:33.385840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03651a-7099-4f05-b8db-c25d34c220e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:33.386469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03651a-7099-4f05-b8db-c25d34c220e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:33.413421 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03651a-7099-4f05-b8db-c25d34c220e1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:33.441893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1257/2514] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:16:33 2021] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:16:33.446810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef7230-5aca-40c7-af91-ba13e57734b2 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:33.457346 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef7230-5aca-40c7-af91-ba13e57734b2 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:33.523791 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3bb90-ede1-4dd2-bbf6-291605194b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:33.524401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3bb90-ede1-4dd2-bbf6-291605194b17 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:33.524694 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3bb90-ede1-4dd2-bbf6-291605194b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:33.524977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3bb90-ede1-4dd2-bbf6-291605194b17 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:33.525612 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3bb90-ede1-4dd2-bbf6-291605194b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:33.552268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3bb90-ede1-4dd2-bbf6-291605194b17 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:33.574768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1258/2515] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:16:33 2021] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:16:33.579529 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03651a-7099-4f05-b8db-c25d34c220e1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:33.592055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03651a-7099-4f05-b8db-c25d34c220e1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:33.596638 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbaee4-7d55-425c-a725-f520452416db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:33.597240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbaee4-7d55-425c-a725-f520452416db admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:33.597539 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbaee4-7d55-425c-a725-f520452416db admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:33.597824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbaee4-7d55-425c-a725-f520452416db admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:33.598547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbaee4-7d55-425c-a725-f520452416db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:33.624742 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbaee4-7d55-425c-a725-f520452416db admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:33.636500 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1258/2516] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:16:33 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:16:33.640867 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3bb90-ede1-4dd2-bbf6-291605194b17 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:33.650355 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3bb90-ede1-4dd2-bbf6-291605194b17 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:33.654667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fa9a2-9756-49a3-807a-6a47db82d5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:33.656308 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fa9a2-9756-49a3-807a-6a47db82d5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:33.656626 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fa9a2-9756-49a3-807a-6a47db82d5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:33.656911 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fa9a2-9756-49a3-807a-6a47db82d5e8 admin admin] PATH_INFO: `/v3/projects/98dc11e3b2494b96a7e1e8a5d9a7b516/users/155100cd4b03445182e947b6c6c3f741/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:33.700638 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fa9a2-9756-49a3-807a-6a47db82d5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dc11e3b2494b96a7e1e8a5d9a7b516, user_id=155100cd4b03445182e947b6c6c3f741, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:33.729026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fa9a2-9756-49a3-807a-6a47db82d5e8 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:33.747401 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1259/2517] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:33 2021] PUT /identity/v3/projects/98dc11e3b2494b96a7e1e8a5d9a7b516/users/155100cd4b03445182e947b6c6c3f741/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:33.751992 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbaee4-7d55-425c-a725-f520452416db admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:33.763053 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbaee4-7d55-425c-a725-f520452416db admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:33.859673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d6c42-5dbb-47d0-8ab2-29113f33a073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:33.860975 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d6c42-5dbb-47d0-8ab2-29113f33a073 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:33.861497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d6c42-5dbb-47d0-8ab2-29113f33a073 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:33.863091 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d6c42-5dbb-47d0-8ab2-29113f33a073 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:33.871194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d6c42-5dbb-47d0-8ab2-29113f33a073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:33.898351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d6c42-5dbb-47d0-8ab2-29113f33a073 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:33.913874 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1259/2518] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:16:33 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:16:33.915505 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fa9a2-9756-49a3-807a-6a47db82d5e8 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:33.927904 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fa9a2-9756-49a3-807a-6a47db82d5e8 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:33.933681 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4838a6d-741a-4fa6-bef3-5917b34fbc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:33.934802 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4838a6d-741a-4fa6-bef3-5917b34fbc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:33.935188 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4838a6d-741a-4fa6-bef3-5917b34fbc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:33.935564 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4838a6d-741a-4fa6-bef3-5917b34fbc5d admin admin] PATH_INFO: `/v3/projects/98dc11e3b2494b96a7e1e8a5d9a7b516/users/155100cd4b03445182e947b6c6c3f741/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:33.937457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4838a6d-741a-4fa6-bef3-5917b34fbc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dc11e3b2494b96a7e1e8a5d9a7b516, user_id=155100cd4b03445182e947b6c6c3f741, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:33.964968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4838a6d-741a-4fa6-bef3-5917b34fbc5d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:33.979879 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1260/2519] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:33 2021] PUT /identity/v3/projects/98dc11e3b2494b96a7e1e8a5d9a7b516/users/155100cd4b03445182e947b6c6c3f741/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:33.981099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d6c42-5dbb-47d0-8ab2-29113f33a073 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:33.998586 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d6c42-5dbb-47d0-8ab2-29113f33a073 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:34.092720 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9a292-cd94-4e87-b3bf-22294bd291d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:34.093877 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9a292-cd94-4e87-b3bf-22294bd291d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:34.094682 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9a292-cd94-4e87-b3bf-22294bd291d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:34.094682 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9a292-cd94-4e87-b3bf-22294bd291d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:34.095336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9a292-cd94-4e87-b3bf-22294bd291d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:34.123369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9a292-cd94-4e87-b3bf-22294bd291d6 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:34.134161 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1260/2520] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:16:33 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:16:34.138474 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4838a6d-741a-4fa6-bef3-5917b34fbc5d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:34.149354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4838a6d-741a-4fa6-bef3-5917b34fbc5d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:34.153968 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d6c0-168f-437b-8578-18684f4c1208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:34.154915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d6c0-168f-437b-8578-18684f4c1208 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:34.155928 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d6c0-168f-437b-8578-18684f4c1208 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:34.156286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d6c0-168f-437b-8578-18684f4c1208 admin admin] PATH_INFO: `/v3/projects/98dc11e3b2494b96a7e1e8a5d9a7b516/users/155100cd4b03445182e947b6c6c3f741/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:34.158205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217d6c0-168f-437b-8578-18684f4c1208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dc11e3b2494b96a7e1e8a5d9a7b516, user_id=155100cd4b03445182e947b6c6c3f741, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:34.185167 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217d6c0-168f-437b-8578-18684f4c1208 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:34.201130 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1261/2521] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:16:34 2021] PUT /identity/v3/projects/98dc11e3b2494b96a7e1e8a5d9a7b516/users/155100cd4b03445182e947b6c6c3f741/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:40.788673 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588df58a-a19f-490f-a0ed-738e7e2980be None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:40.789178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588df58a-a19f-490f-a0ed-738e7e2980be None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:40.789178 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588df58a-a19f-490f-a0ed-738e7e2980be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:40.828553 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-588df58a-a19f-490f-a0ed-738e7e2980be None None] MFA Rules not processed for user `155100cd4b03445182e947b6c6c3f741`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:40.830860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-588df58a-a19f-490f-a0ed-738e7e2980be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:40.914897 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1261/2522] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:40 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:40.925829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d6c0-168f-437b-8578-18684f4c1208 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:40.927532 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-f217d6c0-168f-437b-8578-18684f4c1208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:41.006886 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d6c0-168f-437b-8578-18684f4c1208 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:41.011964 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62102c78-b121-4865-b1fa-94905baafdf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:41.012550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62102c78-b121-4865-b1fa-94905baafdf4 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:41.012840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62102c78-b121-4865-b1fa-94905baafdf4 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:41.013125 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62102c78-b121-4865-b1fa-94905baafdf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:41.080565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62102c78-b121-4865-b1fa-94905baafdf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:41.110142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62102c78-b121-4865-b1fa-94905baafdf4 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:41.120419 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1262/2523] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:16:40 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:16:42.742106 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d963-f468-4ab8-8077-d1ab6132d28d None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:42.742617 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d963-f468-4ab8-8077-d1ab6132d28d None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:42.742746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d963-f468-4ab8-8077-d1ab6132d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:42.766607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-2b57d963-f468-4ab8-8077-d1ab6132d28d None None] MFA Rules not processed for user `41e0b26101294f8297066407a380c700`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:42.767778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-2b57d963-f468-4ab8-8077-d1ab6132d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:42.779401 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1262/2524] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:42 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:16:59.227890 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62102c78-b121-4865-b1fa-94905baafdf4 service nova] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:59.229259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-62102c78-b121-4865-b1fa-94905baafdf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:16:59.312825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62102c78-b121-4865-b1fa-94905baafdf4 service nova] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:59.317565 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:59.318390 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:59.318703 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:59.318990 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] PATH_INFO: `/v3/users/9c7d443e8f994d25b9827efb1b4919bd` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:59.320095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7d443e8f994d25b9827efb1b4919bd)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:59.346432 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:59.405973 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7d443e8f994d25b9827efb1b4919bd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.418554 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7d443e8f994d25b9827efb1b4919bd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.419452 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7d443e8f994d25b9827efb1b4919bd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.428356 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7d443e8f994d25b9827efb1b4919bd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.437730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-ee49e820-baff-4624-8bdf-261905dce1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7d443e8f994d25b9827efb1b4919bd'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.444201 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1263/2525] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:16:59 2021] DELETE /identity/v3/users/9c7d443e8f994d25b9827efb1b4919bd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:16:59.700810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d963-f468-4ab8-8077-d1ab6132d28d None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:16:59.712347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d963-f468-4ab8-8077-d1ab6132d28d None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:16:59.784570 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:16:59.785587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:59.786043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:59.786612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] PATH_INFO: `/v3/projects/1027d0d8d53b4a18a52af1935304a4a4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:59.788011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1027d0d8d53b4a18a52af1935304a4a4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:16:59.817339 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:16:59.881542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1027d0d8d53b4a18a52af1935304a4a4', 'request_id': 'req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.897407 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1027d0d8d53b4a18a52af1935304a4a4', 'request_id': 'req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.916227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1027d0d8d53b4a18a52af1935304a4a4', 'request_id': 'req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.939450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] The token cache is being invalidate because project 1027d0d8d53b4a18a52af1935304a4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:16:59.939734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.940366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d2b52dc9-cbb2-431d-8b1c-90c42b575cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:16:59.942024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1263/2526] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:16:59 2021] DELETE /identity/v3/projects/1027d0d8d53b4a18a52af1935304a4a4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:16:59.949012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c2c9-0875-4bf5-8689-51bd20af9585 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:16:59.949497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c2c9-0875-4bf5-8689-51bd20af9585 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:16:59.949780 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17c2c9-0875-4bf5-8689-51bd20af9585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:16:59.975535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-8a17c2c9-0875-4bf5-8689-51bd20af9585 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:16:59.976876 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8a17c2c9-0875-4bf5-8689-51bd20af9585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:00.051510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1264/2527] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:16:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:17:00.059418 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10081a-1f9e-48c7-ba5c-1091ad66ac62 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:00.059718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10081a-1f9e-48c7-ba5c-1091ad66ac62 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:00.060007 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10081a-1f9e-48c7-ba5c-1091ad66ac62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:00.083750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-5c10081a-1f9e-48c7-ba5c-1091ad66ac62 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:17:00.084832 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-5c10081a-1f9e-48c7-ba5c-1091ad66ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:00.093642 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1264/2528] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:17:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:17:00.098076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17c2c9-0875-4bf5-8689-51bd20af9585 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:00.107591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17c2c9-0875-4bf5-8689-51bd20af9585 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:00.112855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a1109-c09c-423a-af6a-0bcc6caf4f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:00.113449 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a1109-c09c-423a-af6a-0bcc6caf4f64 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:00.113740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a1109-c09c-423a-af6a-0bcc6caf4f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:00.114029 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a1109-c09c-423a-af6a-0bcc6caf4f64 admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:00.114787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a1109-c09c-423a-af6a-0bcc6caf4f64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:17:00.115094 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a1109-c09c-423a-af6a-0bcc6caf4f64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:00.140440 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a1109-c09c-423a-af6a-0bcc6caf4f64 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:00.156420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1265/2529] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:17:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:17:00.160883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10081a-1f9e-48c7-ba5c-1091ad66ac62 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:00.169722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10081a-1f9e-48c7-ba5c-1091ad66ac62 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:00.175488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04aed5-a11b-41ee-a07c-21658fa2b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:00.176093 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04aed5-a11b-41ee-a07c-21658fa2b708 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:00.176384 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04aed5-a11b-41ee-a07c-21658fa2b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:00.176909 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04aed5-a11b-41ee-a07c-21658fa2b708 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:00.177307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04aed5-a11b-41ee-a07c-21658fa2b708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:00.204276 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04aed5-a11b-41ee-a07c-21658fa2b708 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:00.235846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1265/2530] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:17:00 2021] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:17:00.237058 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a1109-c09c-423a-af6a-0bcc6caf4f64 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:00.248729 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a1109-c09c-423a-af6a-0bcc6caf4f64 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:00.326377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c8dd-0f31-4272-b14e-715e5dd8d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:00.327753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c8dd-0f31-4272-b14e-715e5dd8d079 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:00.328246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c8dd-0f31-4272-b14e-715e5dd8d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:00.328767 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c8dd-0f31-4272-b14e-715e5dd8d079 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:00.329730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c8dd-0f31-4272-b14e-715e5dd8d079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:00.361546 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c8dd-0f31-4272-b14e-715e5dd8d079 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:00.383931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1266/2531] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:17:00 2021] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:17:00.388266 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04aed5-a11b-41ee-a07c-21658fa2b708 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:00.400324 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04aed5-a11b-41ee-a07c-21658fa2b708 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:00.405155 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89db477-08da-45f5-bc57-f11fda3f67ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:00.406579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89db477-08da-45f5-bc57-f11fda3f67ad admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:00.407010 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89db477-08da-45f5-bc57-f11fda3f67ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:00.407359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89db477-08da-45f5-bc57-f11fda3f67ad admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:00.408129 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89db477-08da-45f5-bc57-f11fda3f67ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:00.434566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89db477-08da-45f5-bc57-f11fda3f67ad admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:00.446229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1266/2532] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:17:00 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:17:00.450479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c8dd-0f31-4272-b14e-715e5dd8d079 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:00.461048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c8dd-0f31-4272-b14e-715e5dd8d079 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:00.465787 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3959e-84d6-4293-b011-9f94f08e1d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:00.466707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3959e-84d6-4293-b011-9f94f08e1d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:00.467192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3959e-84d6-4293-b011-9f94f08e1d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:00.467477 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3959e-84d6-4293-b011-9f94f08e1d4a admin admin] PATH_INFO: `/v3/projects/732a065710454a0bb5503b4cde9856da/users/18862da5aa3c4d0f8395f600af08489f/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:00.490181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3959e-84d6-4293-b011-9f94f08e1d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=732a065710454a0bb5503b4cde9856da, user_id=18862da5aa3c4d0f8395f600af08489f, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:00.517377 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3959e-84d6-4293-b011-9f94f08e1d4a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:00.531924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1267/2533] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:17:00 2021] PUT /identity/v3/projects/732a065710454a0bb5503b4cde9856da/users/18862da5aa3c4d0f8395f600af08489f/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:17:00.537184 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fcf05-37d0-4880-b546-ee86b5734ae0 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:00.537423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fcf05-37d0-4880-b546-ee86b5734ae0 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:00.537732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fcf05-37d0-4880-b546-ee86b5734ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:00.562262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-487fcf05-37d0-4880-b546-ee86b5734ae0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:17:00.563552 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-487fcf05-37d0-4880-b546-ee86b5734ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:00.634856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1267/2534] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:17:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:17:00.645655 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3959e-84d6-4293-b011-9f94f08e1d4a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:00.647526 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8dc3959e-84d6-4293-b011-9f94f08e1d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:00.722482 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3959e-84d6-4293-b011-9f94f08e1d4a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:00.726075 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f64557-9353-4254-9112-7578df01ae72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:00.726721 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f64557-9353-4254-9112-7578df01ae72 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:00.727074 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f64557-9353-4254-9112-7578df01ae72 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:00.727286 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f64557-9353-4254-9112-7578df01ae72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:00.737333 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f64557-9353-4254-9112-7578df01ae72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:00.763115 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f64557-9353-4254-9112-7578df01ae72 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:00.773852 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1268/2535] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:03.375310 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fcf05-37d0-4880-b546-ee86b5734ae0 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:03.377192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-487fcf05-37d0-4880-b546-ee86b5734ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:03.448088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fcf05-37d0-4880-b546-ee86b5734ae0 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:03.451778 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:03.452580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:03.452872 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:03.453365 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:03.455712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:03.560533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:03.590008 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:03.605181 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1268/2536] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:03 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:04.187276 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f64557-9353-4254-9112-7578df01ae72 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:04.197697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f64557-9353-4254-9112-7578df01ae72 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:04.203249 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcd7ed-0d20-4997-a2c5-7f97de78a272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:04.204686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcd7ed-0d20-4997-a2c5-7f97de78a272 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:04.205053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcd7ed-0d20-4997-a2c5-7f97de78a272 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:04.205345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcd7ed-0d20-4997-a2c5-7f97de78a272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:04.207136 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-1bfcd7ed-0d20-4997-a2c5-7f97de78a272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:04.222108 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcd7ed-0d20-4997-a2c5-7f97de78a272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:04.252892 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcd7ed-0d20-4997-a2c5-7f97de78a272 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:04.263134 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1269/2537] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:04 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:05.105559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:05.108794 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:05.158561 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcd7ed-0d20-4997-a2c5-7f97de78a272 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:05.173240 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcd7ed-0d20-4997-a2c5-7f97de78a272 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:05.177405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:05.178765 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:05.179641 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:05.180296 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:05.183198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:05.199459 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:05.231032 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:05.240098 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494c439-5861-428f-9a1b-68e9248ba656 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:05.246033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e17be1-db2f-4f2e-8a2b-8c0881d7aeeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:05.247036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e17be1-db2f-4f2e-8a2b-8c0881d7aeeb service placement] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:05.247547 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e17be1-db2f-4f2e-8a2b-8c0881d7aeeb service placement] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:05.247807 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1270/2538] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:05 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:17:05.248295 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e17be1-db2f-4f2e-8a2b-8c0881d7aeeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:05.251081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-57e17be1-db2f-4f2e-8a2b-8c0881d7aeeb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:05.267361 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e17be1-db2f-4f2e-8a2b-8c0881d7aeeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:05.298982 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e17be1-db2f-4f2e-8a2b-8c0881d7aeeb service placement] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:05.311251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1269/2539] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:05 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:05.434873 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:05.437080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:05.451386 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dcc93-358a-46bb-8a0b-3cb70191b6f5 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:05.456243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fb482-84f5-484d-a608-44e0780afd40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:05.456936 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fb482-84f5-484d-a608-44e0780afd40 service placement] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:05.457326 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fb482-84f5-484d-a608-44e0780afd40 service placement] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:05.457788 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fb482-84f5-484d-a608-44e0780afd40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:05.459704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ee4fb482-84f5-484d-a608-44e0780afd40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:05.471224 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fb482-84f5-484d-a608-44e0780afd40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:05.499908 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fb482-84f5-484d-a608-44e0780afd40 service placement] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:05.511142 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1271/2540] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:05 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:06.266683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d017-1001-49df-bfe9-14b7f9f94949 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:06.268029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d017-1001-49df-bfe9-14b7f9f94949 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:06.268497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d017-1001-49df-bfe9-14b7f9f94949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:06.309706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-8a68d017-1001-49df-bfe9-14b7f9f94949 None None] MFA Rules not processed for user `18862da5aa3c4d0f8395f600af08489f`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:17:06.311003 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8a68d017-1001-49df-bfe9-14b7f9f94949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:06.385479 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1270/2541] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:17:06 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:17:06.397138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fb482-84f5-484d-a608-44e0780afd40 service placement] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:06.409806 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fb482-84f5-484d-a608-44e0780afd40 service placement] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:06.414928 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f3a9-8fbd-491a-84f9-5a3f8711d27d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:06.415581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f3a9-8fbd-491a-84f9-5a3f8711d27d service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:06.415945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f3a9-8fbd-491a-84f9-5a3f8711d27d service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:06.416300 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f3a9-8fbd-491a-84f9-5a3f8711d27d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:06.425230 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14f3a9-8fbd-491a-84f9-5a3f8711d27d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:06.450824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14f3a9-8fbd-491a-84f9-5a3f8711d27d service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:06.461216 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1272/2542] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:06 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:08.640542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530259a-4a31-4679-a2d1-5320aff7f0c5 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:08.641569 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530259a-4a31-4679-a2d1-5320aff7f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:08.642024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530259a-4a31-4679-a2d1-5320aff7f0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:08.667347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6530259a-4a31-4679-a2d1-5320aff7f0c5 None None] MFA Rules not processed for user `18862da5aa3c4d0f8395f600af08489f`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:17:08.668797 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6530259a-4a31-4679-a2d1-5320aff7f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:08.675160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1271/2543] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:17:08 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:17:08.900255 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f3a9-8fbd-491a-84f9-5a3f8711d27d service nova] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:08.902581 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6e14f3a9-8fbd-491a-84f9-5a3f8711d27d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:08.922215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f3a9-8fbd-491a-84f9-5a3f8711d27d service nova] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:08.925928 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996a077-8070-4be5-ac5e-5e003b2a5599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:08.926542 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996a077-8070-4be5-ac5e-5e003b2a5599 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:08.926864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996a077-8070-4be5-ac5e-5e003b2a5599 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:08.927150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996a077-8070-4be5-ac5e-5e003b2a5599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:08.928845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5996a077-8070-4be5-ac5e-5e003b2a5599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:08.941182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996a077-8070-4be5-ac5e-5e003b2a5599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:08.969607 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996a077-8070-4be5-ac5e-5e003b2a5599 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:08.990151 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1273/2544] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:08 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:09.281888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530259a-4a31-4679-a2d1-5320aff7f0c5 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:09.291847 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530259a-4a31-4679-a2d1-5320aff7f0c5 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:09.295246 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffadd3c-a124-4314-8b3d-e4bbde621f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:09.296445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffadd3c-a124-4314-8b3d-e4bbde621f7e service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:09.296796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffadd3c-a124-4314-8b3d-e4bbde621f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:09.297086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffadd3c-a124-4314-8b3d-e4bbde621f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:09.298775 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-dffadd3c-a124-4314-8b3d-e4bbde621f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:09.309175 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffadd3c-a124-4314-8b3d-e4bbde621f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:09.335257 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffadd3c-a124-4314-8b3d-e4bbde621f7e service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:09.344300 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1272/2545] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:09 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:13.017457 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996a077-8070-4be5-ac5e-5e003b2a5599 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:13.048816 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996a077-8070-4be5-ac5e-5e003b2a5599 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:13.054826 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ccc4-a9d7-4484-b7fb-710ef5b57a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:13.055733 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ccc4-a9d7-4484-b7fb-710ef5b57a85 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:13.056257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ccc4-a9d7-4484-b7fb-710ef5b57a85 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:13.056753 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ccc4-a9d7-4484-b7fb-710ef5b57a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:13.058784 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5e95ccc4-a9d7-4484-b7fb-710ef5b57a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:13.083121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95ccc4-a9d7-4484-b7fb-710ef5b57a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:13.119927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95ccc4-a9d7-4484-b7fb-710ef5b57a85 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:13.138834 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1274/2546] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:13 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:23.426377 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffadd3c-a124-4314-8b3d-e4bbde621f7e service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:23.435125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffadd3c-a124-4314-8b3d-e4bbde621f7e service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:23.439651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:23.440243 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:23.440535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:23.440820 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:23.442524 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:23.515516 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:23.540537 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:23.551107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1273/2547] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:23 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:27.203699 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ccc4-a9d7-4484-b7fb-710ef5b57a85 service nova] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:27.215766 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ccc4-a9d7-4484-b7fb-710ef5b57a85 service nova] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:27.222382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b8c0-3dff-4cba-afbd-ae8f20925640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:27.223146 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b8c0-3dff-4cba-afbd-ae8f20925640 service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:27.223446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b8c0-3dff-4cba-afbd-ae8f20925640 service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:27.224112 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b8c0-3dff-4cba-afbd-ae8f20925640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:27.225977 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ab16b8c0-3dff-4cba-afbd-ae8f20925640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:27.239400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b8c0-3dff-4cba-afbd-ae8f20925640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:27.271376 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b8c0-3dff-4cba-afbd-ae8f20925640 service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:27.287824 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1275/2548] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:27 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:36.568329 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:36.569898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:36.582274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dafcf7-7839-4272-b269-1f5757e3c731 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:36.585782 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:36.586433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:36.586746 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:36.587025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:36.588814 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:36.656394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:36.681352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:36.690827 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1274/2549] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:36 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:17:42.035036 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d48efb-1152-4f80-8b1a-2b2960ce2547 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:42.036056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d48efb-1152-4f80-8b1a-2b2960ce2547 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:42.036535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d48efb-1152-4f80-8b1a-2b2960ce2547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:42.059843 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-84d48efb-1152-4f80-8b1a-2b2960ce2547 None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:17:42.061755 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-84d48efb-1152-4f80-8b1a-2b2960ce2547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:42.125244 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1276/2550] 10.222.0.36 () {58 vars in 967 bytes} [Wed Oct 27 14:17:42 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:17:42.175577 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:42.177045 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:42.261632 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bda7a9-0b46-4476-9b5e-1792e38c3b24 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:42.275301 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a6cd-07f6-410d-b86d-e8f9bcdf65a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:42.276333 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a6cd-07f6-410d-b86d-e8f9bcdf65a7 service swift] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:42.276883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a6cd-07f6-410d-b86d-e8f9bcdf65a7 service swift] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:42.277325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a6cd-07f6-410d-b86d-e8f9bcdf65a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:42.290113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32a6cd-07f6-410d-b86d-e8f9bcdf65a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:42.320322 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32a6cd-07f6-410d-b86d-e8f9bcdf65a7 service swift] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:42.330082 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1275/2551] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:17:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:17:44.457304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9723-dbbb-4d4e-bb9a-9cb9e5bbf3af None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:44.457878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9723-dbbb-4d4e-bb9a-9cb9e5bbf3af None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:44.457998 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9723-dbbb-4d4e-bb9a-9cb9e5bbf3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:44.482701 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6d9c9723-dbbb-4d4e-bb9a-9cb9e5bbf3af None None] MFA Rules not processed for user `45b340bfc21940979721e201c67e12a6`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:17:44.484215 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6d9c9723-dbbb-4d4e-bb9a-9cb9e5bbf3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:44.491704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1277/2552] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:17:44 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:17:55.449237 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a6cd-07f6-410d-b86d-e8f9bcdf65a7 service swift] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:55.450606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4c32a6cd-07f6-410d-b86d-e8f9bcdf65a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:55.464006 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a6cd-07f6-410d-b86d-e8f9bcdf65a7 service swift] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:55.468884 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:55.469970 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:55.470463 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:55.470979 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] PATH_INFO: `/v3/users/0f58edc0163044bc85bed3e29e1fdd01` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:55.472567 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f58edc0163044bc85bed3e29e1fdd01)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:55.501259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:55.553893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f58edc0163044bc85bed3e29e1fdd01'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:55.567206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f58edc0163044bc85bed3e29e1fdd01'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:55.568214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f58edc0163044bc85bed3e29e1fdd01'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:55.576057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f58edc0163044bc85bed3e29e1fdd01'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:55.585084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f58edc0163044bc85bed3e29e1fdd01'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:55.591325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1276/2553] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:17:55 2021] DELETE /identity/v3/users/0f58edc0163044bc85bed3e29e1fdd01 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:17:55.825938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c9723-dbbb-4d4e-bb9a-9cb9e5bbf3af None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:55.837892 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c9723-dbbb-4d4e-bb9a-9cb9e5bbf3af None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:55.901797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:55.902590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:55.902917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:55.903206 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] PATH_INFO: `/v3/projects/17464c5131664d84a88aee4a92d27614` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:55.904387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17464c5131664d84a88aee4a92d27614)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:55.931344 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:55.987426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17464c5131664d84a88aee4a92d27614', 'request_id': 'req-a5adf914-3852-4022-8cf1-05d606217e2d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.011042 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17464c5131664d84a88aee4a92d27614', 'request_id': 'req-a5adf914-3852-4022-8cf1-05d606217e2d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.025569 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17464c5131664d84a88aee4a92d27614', 'request_id': 'req-a5adf914-3852-4022-8cf1-05d606217e2d'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.038676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] The token cache is being invalidate because project 17464c5131664d84a88aee4a92d27614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:17:56.038974 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.039599 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.041059 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1278/2554] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:17:55 2021] DELETE /identity/v3/projects/17464c5131664d84a88aee4a92d27614 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:17:56.045803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:56.047841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:56.060289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66e40f-bf16-4238-b555-daf462c4a618 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:56.128287 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:56.129147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:56.129437 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:56.129719 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] PATH_INFO: `/v3/users/c93e6a9d560b44ec8a08f021fe1361fe` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:56.130850 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93e6a9d560b44ec8a08f021fe1361fe)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:56.157386 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:56.211659 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93e6a9d560b44ec8a08f021fe1361fe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.224033 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93e6a9d560b44ec8a08f021fe1361fe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.224845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93e6a9d560b44ec8a08f021fe1361fe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.232521 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93e6a9d560b44ec8a08f021fe1361fe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.239845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93e6a9d560b44ec8a08f021fe1361fe'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.246512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1277/2555] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:17:56 2021] DELETE /identity/v3/users/c93e6a9d560b44ec8a08f021fe1361fe => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:17:56.399389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:56.401001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:56.496505 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:17:56.499395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:56.499680 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adf914-3852-4022-8cf1-05d606217e2d admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:56.581765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59fcdd-4a54-4074-be4e-7ec6ee49befe admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:17:56.584322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbd643-1f0d-4097-9429-1052dede3d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:56.584915 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbd643-1f0d-4097-9429-1052dede3d9e service nova] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:56.585207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbd643-1f0d-4097-9429-1052dede3d9e service nova] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:56.585495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbd643-1f0d-4097-9429-1052dede3d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:56.587349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-29cbd643-1f0d-4097-9429-1052dede3d9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:17:56.588456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:17:56.589573 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:17:56.590024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:17:56.590588 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] PATH_INFO: `/v3/projects/1604dadc7e904ed9987e7ded1bc59258` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:17:56.591896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1604dadc7e904ed9987e7ded1bc59258)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:56.599300 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbd643-1f0d-4097-9429-1052dede3d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:17:56.621113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:56.626341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbd643-1f0d-4097-9429-1052dede3d9e service nova] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:17:56.636978 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1279/2556] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:17:56 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:17:56.677707 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1604dadc7e904ed9987e7ded1bc59258', 'request_id': 'req-76aea0a3-21c5-422b-915f-c19aeb0f329e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.772230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1604dadc7e904ed9987e7ded1bc59258', 'request_id': 'req-76aea0a3-21c5-422b-915f-c19aeb0f329e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.780621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1604dadc7e904ed9987e7ded1bc59258', 'request_id': 'req-76aea0a3-21c5-422b-915f-c19aeb0f329e'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.791513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] The token cache is being invalidate because project 1604dadc7e904ed9987e7ded1bc59258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:17:56.792086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.792861 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-76aea0a3-21c5-422b-915f-c19aeb0f329e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:17:56.794699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1278/2557] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:17:56 2021] DELETE /identity/v3/projects/1604dadc7e904ed9987e7ded1bc59258 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:18:17.591837 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f83f0-8c5f-49f8-8ef4-31125739e81b None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:18:17.592366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f83f0-8c5f-49f8-8ef4-31125739e81b None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:18:17.592476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f83f0-8c5f-49f8-8ef4-31125739e81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:18:17.615361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-225f83f0-8c5f-49f8-8ef4-31125739e81b None None] MFA Rules not processed for user `884b2c83926146828276418e0101925f`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:18:17.616506 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-225f83f0-8c5f-49f8-8ef4-31125739e81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:18:17.677267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1280/2558] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:18:17 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:18:32.773889 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062ac2d-fdd0-4eff-ac8d-730b664e12ca None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:18:32.774845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062ac2d-fdd0-4eff-ac8d-730b664e12ca None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:18:32.775159 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062ac2d-fdd0-4eff-ac8d-730b664e12ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:18:32.800836 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-7062ac2d-fdd0-4eff-ac8d-730b664e12ca None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:18:32.801947 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7062ac2d-fdd0-4eff-ac8d-730b664e12ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:18:32.869113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1279/2559] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:18:32 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:18:32.882287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f83f0-8c5f-49f8-8ef4-31125739e81b None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:18:32.883905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-225f83f0-8c5f-49f8-8ef4-31125739e81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:18:32.962945 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f83f0-8c5f-49f8-8ef4-31125739e81b None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:18:32.967567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57837b0a-c73e-48a9-a755-f45ed56377d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:18:32.968157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57837b0a-c73e-48a9-a755-f45ed56377d1 service swift] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:18:32.968448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57837b0a-c73e-48a9-a755-f45ed56377d1 service swift] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:18:32.968736 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57837b0a-c73e-48a9-a755-f45ed56377d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:18:32.978133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57837b0a-c73e-48a9-a755-f45ed56377d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:18:33.006107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57837b0a-c73e-48a9-a755-f45ed56377d1 service swift] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:18:33.015883 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1281/2560] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:18:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:18:48.638462 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aeb8f-4535-447f-b68e-bf99184b5767 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:18:48.639435 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aeb8f-4535-447f-b68e-bf99184b5767 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:18:48.639722 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aeb8f-4535-447f-b68e-bf99184b5767 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:18:48.641689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1280/2561] 10.222.0.36 () {54 vars in 921 bytes} [Wed Oct 27 14:18:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:18:48.647329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fa673-766f-4d53-8d61-87fd0d7a389a None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:18:48.648851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fa673-766f-4d53-8d61-87fd0d7a389a None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:18:48.649527 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fa673-766f-4d53-8d61-87fd0d7a389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:18:48.676048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-b82fa673-766f-4d53-8d61-87fd0d7a389a None None] MFA Rules not processed for user `dea5ec2125f0468baa1e15a429021e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:18:48.677210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-b82fa673-766f-4d53-8d61-87fd0d7a389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:18:48.737289 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1282/2562] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Oct 27 14:18:48 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:18:48.750054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aeb8f-4535-447f-b68e-bf99184b5767 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:18:48.751663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a13aeb8f-4535-447f-b68e-bf99184b5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:18:48.765649 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aeb8f-4535-447f-b68e-bf99184b5767 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:18:48.769122 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340686-296d-4dd3-87d2-473c8480062e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:18:48.769702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340686-296d-4dd3-87d2-473c8480062e service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:18:48.769992 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340686-296d-4dd3-87d2-473c8480062e service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:18:48.770278 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340686-296d-4dd3-87d2-473c8480062e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:18:48.780658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16340686-296d-4dd3-87d2-473c8480062e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:18:48.806071 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16340686-296d-4dd3-87d2-473c8480062e service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:18:48.815414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1281/2563] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:18:48 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:18:54.747290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deedb2-3aa6-4b44-94af-c1e84d68707e None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:18:54.747819 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deedb2-3aa6-4b44-94af-c1e84d68707e None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:18:54.748305 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deedb2-3aa6-4b44-94af-c1e84d68707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:18:54.790458 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-99deedb2-3aa6-4b44-94af-c1e84d68707e None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:18:54.791671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-99deedb2-3aa6-4b44-94af-c1e84d68707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:18:54.798362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1283/2564] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:18:54 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:18:54.809898 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340686-296d-4dd3-87d2-473c8480062e service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:18:54.821930 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340686-296d-4dd3-87d2-473c8480062e service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:18:54.826378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e53d7-bb62-42c5-9d7f-bafc111f1141 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:18:54.827776 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e53d7-bb62-42c5-9d7f-bafc111f1141 service swift] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:18:54.828153 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e53d7-bb62-42c5-9d7f-bafc111f1141 service swift] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:18:54.828571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e53d7-bb62-42c5-9d7f-bafc111f1141 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:18:54.837061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e53d7-bb62-42c5-9d7f-bafc111f1141 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:18:54.865761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e53d7-bb62-42c5-9d7f-bafc111f1141 service swift] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:18:54.876842 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1282/2565] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:18:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 14:19:20.685152 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02420195-6fd8-44ac-b6cc-acbae486d0b7 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:20.685685 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02420195-6fd8-44ac-b6cc-acbae486d0b7 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:20.685773 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02420195-6fd8-44ac-b6cc-acbae486d0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:20.708634 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-02420195-6fd8-44ac-b6cc-acbae486d0b7 None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:20.709782 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-02420195-6fd8-44ac-b6cc-acbae486d0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:20.716421 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1284/2566] 10.222.0.36 () {58 vars in 967 bytes} [Wed Oct 27 14:19:20 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:19:20.729513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e53d7-bb62-42c5-9d7f-bafc111f1141 service swift] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:20.741197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e53d7-bb62-42c5-9d7f-bafc111f1141 service swift] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:20.745892 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce69c4-65b4-4dda-bac7-5e33eeaf2a36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:20.746473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce69c4-65b4-4dda-bac7-5e33eeaf2a36 service swift] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:20.746815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce69c4-65b4-4dda-bac7-5e33eeaf2a36 service swift] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:20.747103 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce69c4-65b4-4dda-bac7-5e33eeaf2a36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:20.756356 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce69c4-65b4-4dda-bac7-5e33eeaf2a36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:20.782368 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce69c4-65b4-4dda-bac7-5e33eeaf2a36 service swift] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:20.790817 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1283/2567] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:19:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:19:31.714417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02420195-6fd8-44ac-b6cc-acbae486d0b7 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:31.724359 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02420195-6fd8-44ac-b6cc-acbae486d0b7 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:31.727637 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88629b8-4fbf-4580-9054-9b2d3ba96e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:31.728210 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88629b8-4fbf-4580-9054-9b2d3ba96e30 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:31.728499 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88629b8-4fbf-4580-9054-9b2d3ba96e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:31.728781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88629b8-4fbf-4580-9054-9b2d3ba96e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:31.730420 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a88629b8-4fbf-4580-9054-9b2d3ba96e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:31.801930 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88629b8-4fbf-4580-9054-9b2d3ba96e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:31.826704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88629b8-4fbf-4580-9054-9b2d3ba96e30 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:31.837405 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1285/2568] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:19:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:19:37.791864 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce69c4-65b4-4dda-bac7-5e33eeaf2a36 service swift] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:37.793213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a5ce69c4-65b4-4dda-bac7-5e33eeaf2a36 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:37.806225 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce69c4-65b4-4dda-bac7-5e33eeaf2a36 service swift] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:37.810370 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:37.811202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:37.811493 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:37.811774 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] PATH_INFO: `/v3/users/45b340bfc21940979721e201c67e12a6` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:37.812845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b340bfc21940979721e201c67e12a6)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:37.839465 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:37.889622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b340bfc21940979721e201c67e12a6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:37.902281 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b340bfc21940979721e201c67e12a6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:37.902973 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b340bfc21940979721e201c67e12a6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:37.910469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b340bfc21940979721e201c67e12a6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:37.916936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-66483fd6-86e1-4a25-ac5d-492db1076dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b340bfc21940979721e201c67e12a6'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:37.922737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1284/2569] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:19:37 2021] DELETE /identity/v3/users/45b340bfc21940979721e201c67e12a6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:38.172840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88629b8-4fbf-4580-9054-9b2d3ba96e30 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:38.185373 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88629b8-4fbf-4580-9054-9b2d3ba96e30 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:38.249417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:38.250201 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:38.250493 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:38.250817 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] PATH_INFO: `/v3/projects/a32d3bb833eb4a8ea5bb9428523f7587` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:38.251891 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32d3bb833eb4a8ea5bb9428523f7587)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:38.278192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:38.329454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32d3bb833eb4a8ea5bb9428523f7587', 'request_id': 'req-5d698190-dfa8-4ef9-a357-5751741fbf44'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:38.341086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32d3bb833eb4a8ea5bb9428523f7587', 'request_id': 'req-5d698190-dfa8-4ef9-a357-5751741fbf44'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:38.348320 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32d3bb833eb4a8ea5bb9428523f7587', 'request_id': 'req-5d698190-dfa8-4ef9-a357-5751741fbf44'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:38.358330 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] The token cache is being invalidate because project a32d3bb833eb4a8ea5bb9428523f7587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:19:38.358740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:38.359384 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5d698190-dfa8-4ef9-a357-5751741fbf44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:38.360831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1286/2570] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:19:38 2021] DELETE /identity/v3/projects/a32d3bb833eb4a8ea5bb9428523f7587 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:38.367394 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef89b3-226e-4ad4-a3d7-0297122d4db6 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:38.367688 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef89b3-226e-4ad4-a3d7-0297122d4db6 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:38.367971 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef89b3-226e-4ad4-a3d7-0297122d4db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:38.390650 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-71ef89b3-226e-4ad4-a3d7-0297122d4db6 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:38.391779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-71ef89b3-226e-4ad4-a3d7-0297122d4db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:38.458817 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1285/2571] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:38.467157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761ae5-006c-4357-819a-aa0213bb7303 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:38.467667 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761ae5-006c-4357-819a-aa0213bb7303 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:38.468131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761ae5-006c-4357-819a-aa0213bb7303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:38.494409 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-c7761ae5-006c-4357-819a-aa0213bb7303 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:38.495642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-c7761ae5-006c-4357-819a-aa0213bb7303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:38.504052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1287/2572] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:38.508549 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef89b3-226e-4ad4-a3d7-0297122d4db6 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:38.518059 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef89b3-226e-4ad4-a3d7-0297122d4db6 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:38.522398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b93004-7cce-455a-89fd-f26b851c23fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:38.523024 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b93004-7cce-455a-89fd-f26b851c23fc admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:38.523311 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b93004-7cce-455a-89fd-f26b851c23fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:38.523593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b93004-7cce-455a-89fd-f26b851c23fc admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:38.524269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b93004-7cce-455a-89fd-f26b851c23fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:19:38.524566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b93004-7cce-455a-89fd-f26b851c23fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:38.550593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b93004-7cce-455a-89fd-f26b851c23fc admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:38.564220 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1286/2573] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:19:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:19:38.569363 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7761ae5-006c-4357-819a-aa0213bb7303 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:38.578730 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7761ae5-006c-4357-819a-aa0213bb7303 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:38.583079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56164b0e-ed10-4097-b68c-acbeebba2348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:38.583671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56164b0e-ed10-4097-b68c-acbeebba2348 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:38.583963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56164b0e-ed10-4097-b68c-acbeebba2348 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:38.584250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56164b0e-ed10-4097-b68c-acbeebba2348 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:38.584893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56164b0e-ed10-4097-b68c-acbeebba2348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:38.610562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56164b0e-ed10-4097-b68c-acbeebba2348 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:38.652487 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1288/2574] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:19:38 2021] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:38.653964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b93004-7cce-455a-89fd-f26b851c23fc admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:38.664542 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b93004-7cce-455a-89fd-f26b851c23fc admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:38.727940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc7d31-ae76-45f6-ac8a-a90f5b67ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:38.728551 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc7d31-ae76-45f6-ac8a-a90f5b67ad87 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:38.728845 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc7d31-ae76-45f6-ac8a-a90f5b67ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:38.729134 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc7d31-ae76-45f6-ac8a-a90f5b67ad87 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:38.729763 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc7d31-ae76-45f6-ac8a-a90f5b67ad87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:38.761692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc7d31-ae76-45f6-ac8a-a90f5b67ad87 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:38.786853 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1287/2575] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:19:38 2021] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:38.790913 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56164b0e-ed10-4097-b68c-acbeebba2348 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:38.801590 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56164b0e-ed10-4097-b68c-acbeebba2348 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:38.806307 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255678b-8ef0-450c-9503-acc698a7004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:38.806951 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255678b-8ef0-450c-9503-acc698a7004f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:38.807250 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255678b-8ef0-450c-9503-acc698a7004f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:38.807536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255678b-8ef0-450c-9503-acc698a7004f admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:38.808438 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255678b-8ef0-450c-9503-acc698a7004f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:38.834587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255678b-8ef0-450c-9503-acc698a7004f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:38.848648 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1289/2576] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:38 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:38.855599 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc7d31-ae76-45f6-ac8a-a90f5b67ad87 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:38.866330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc7d31-ae76-45f6-ac8a-a90f5b67ad87 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:38.870503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7bd5b-997d-44e6-9554-befcb5a2d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:38.871546 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7bd5b-997d-44e6-9554-befcb5a2d99c admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:38.872047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7bd5b-997d-44e6-9554-befcb5a2d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:38.872341 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7bd5b-997d-44e6-9554-befcb5a2d99c admin admin] PATH_INFO: `/v3/projects/62857ab0c441461fb99b97a2e53b8321/users/0f65bb70b75a4023861bf1870660b6d2/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:38.895176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7bd5b-997d-44e6-9554-befcb5a2d99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62857ab0c441461fb99b97a2e53b8321, user_id=0f65bb70b75a4023861bf1870660b6d2, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:38.926527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7bd5b-997d-44e6-9554-befcb5a2d99c admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:38.947656 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1288/2577] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:38 2021] PUT /identity/v3/projects/62857ab0c441461fb99b97a2e53b8321/users/0f65bb70b75a4023861bf1870660b6d2/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:38.957659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abbda7-2ae8-4669-9602-21029b26648f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:38.957958 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abbda7-2ae8-4669-9602-21029b26648f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:38.958247 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abbda7-2ae8-4669-9602-21029b26648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.006140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-18abbda7-2ae8-4669-9602-21029b26648f None None] MFA Rules not processed for user `0f65bb70b75a4023861bf1870660b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:39.007704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-18abbda7-2ae8-4669-9602-21029b26648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:39.084743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1290/2578] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:38 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:39.089229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7bd5b-997d-44e6-9554-befcb5a2d99c admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:39.167594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7bd5b-997d-44e6-9554-befcb5a2d99c admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:39.171806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404a872-aaa1-4e55-b2dd-88c6922626b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:39.172398 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404a872-aaa1-4e55-b2dd-88c6922626b4 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:39.172689 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404a872-aaa1-4e55-b2dd-88c6922626b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:39.172972 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404a872-aaa1-4e55-b2dd-88c6922626b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.173612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404a872-aaa1-4e55-b2dd-88c6922626b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:39.198948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404a872-aaa1-4e55-b2dd-88c6922626b4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:39.225747 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1289/2579] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:19:39 2021] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:39.229737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abbda7-2ae8-4669-9602-21029b26648f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:39.240611 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abbda7-2ae8-4669-9602-21029b26648f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:39.305924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36d770-11e2-4a68-abe0-b576cd3d67fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:39.306442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d770-11e2-4a68-abe0-b576cd3d67fc admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:39.306760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d770-11e2-4a68-abe0-b576cd3d67fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:39.307046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d770-11e2-4a68-abe0-b576cd3d67fc admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.307687 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36d770-11e2-4a68-abe0-b576cd3d67fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:39.336207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36d770-11e2-4a68-abe0-b576cd3d67fc admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:39.360789 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1291/2580] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:19:39 2021] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:19:39.362359 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404a872-aaa1-4e55-b2dd-88c6922626b4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:39.372026 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404a872-aaa1-4e55-b2dd-88c6922626b4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:39.376202 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6e73-17c3-4f6e-9cf3-9334cc94e037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:39.376788 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6e73-17c3-4f6e-9cf3-9334cc94e037 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:39.377076 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6e73-17c3-4f6e-9cf3-9334cc94e037 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:39.377354 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6e73-17c3-4f6e-9cf3-9334cc94e037 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.378710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a6e73-17c3-4f6e-9cf3-9334cc94e037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:39.404075 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a6e73-17c3-4f6e-9cf3-9334cc94e037 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:39.415670 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1290/2581] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:39 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:39.420017 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36d770-11e2-4a68-abe0-b576cd3d67fc admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:39.430453 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36d770-11e2-4a68-abe0-b576cd3d67fc admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:39.434747 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c83438-e964-491b-a0fe-672ab5d9c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:39.435559 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c83438-e964-491b-a0fe-672ab5d9c106 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:39.435853 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c83438-e964-491b-a0fe-672ab5d9c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:39.436135 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c83438-e964-491b-a0fe-672ab5d9c106 admin admin] PATH_INFO: `/v3/projects/a7878c521cbf42b4a6ff60da10ffe1ff/users/bda7cd9147f04771b55eebcefe5643af/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.540571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c83438-e964-491b-a0fe-672ab5d9c106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7878c521cbf42b4a6ff60da10ffe1ff, user_id=bda7cd9147f04771b55eebcefe5643af, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:39.567719 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c83438-e964-491b-a0fe-672ab5d9c106 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:39.582413 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1292/2582] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:39 2021] PUT /identity/v3/projects/a7878c521cbf42b4a6ff60da10ffe1ff/users/bda7cd9147f04771b55eebcefe5643af/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:19:39.586752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6e73-17c3-4f6e-9cf3-9334cc94e037 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:39.596683 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6e73-17c3-4f6e-9cf3-9334cc94e037 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:39.658976 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b97a8a-b06c-464b-aa95-11277e58ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:39.659606 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b97a8a-b06c-464b-aa95-11277e58ea97 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:39.659917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b97a8a-b06c-464b-aa95-11277e58ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:39.660203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b97a8a-b06c-464b-aa95-11277e58ea97 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.660919 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b97a8a-b06c-464b-aa95-11277e58ea97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:39.686117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b97a8a-b06c-464b-aa95-11277e58ea97 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:39.696954 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1291/2583] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:39 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:19:39.701443 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c83438-e964-491b-a0fe-672ab5d9c106 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:39.713659 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c83438-e964-491b-a0fe-672ab5d9c106 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:39.718220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a19e-7542-46f0-b371-5cd624759c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:39.719063 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a19e-7542-46f0-b371-5cd624759c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:39.719349 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a19e-7542-46f0-b371-5cd624759c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:39.719630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a19e-7542-46f0-b371-5cd624759c4f admin admin] PATH_INFO: `/v3/projects/a7878c521cbf42b4a6ff60da10ffe1ff/users/bda7cd9147f04771b55eebcefe5643af/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.721387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520a19e-7542-46f0-b371-5cd624759c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7878c521cbf42b4a6ff60da10ffe1ff, user_id=bda7cd9147f04771b55eebcefe5643af, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:39.753407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520a19e-7542-46f0-b371-5cd624759c4f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:39.763889 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1293/2584] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:39 2021] PUT /identity/v3/projects/a7878c521cbf42b4a6ff60da10ffe1ff/users/bda7cd9147f04771b55eebcefe5643af/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:19:39.767815 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b97a8a-b06c-464b-aa95-11277e58ea97 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:39.778290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b97a8a-b06c-464b-aa95-11277e58ea97 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:39.843218 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce8ee2-fb73-4e9f-9a27-f1791f4d33f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:39.843728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8ee2-fb73-4e9f-9a27-f1791f4d33f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:39.844013 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8ee2-fb73-4e9f-9a27-f1791f4d33f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:39.844313 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8ee2-fb73-4e9f-9a27-f1791f4d33f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.844993 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce8ee2-fb73-4e9f-9a27-f1791f4d33f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:39.871715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce8ee2-fb73-4e9f-9a27-f1791f4d33f9 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:39.882810 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1292/2585] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:39 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:39.886975 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a19e-7542-46f0-b371-5cd624759c4f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:39.897737 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a19e-7542-46f0-b371-5cd624759c4f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:39.901795 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79780-d3cb-405f-bc01-a58781c45d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:39.902589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79780-d3cb-405f-bc01-a58781c45d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:39.902903 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79780-d3cb-405f-bc01-a58781c45d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:39.903182 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79780-d3cb-405f-bc01-a58781c45d1a admin admin] PATH_INFO: `/v3/projects/a7878c521cbf42b4a6ff60da10ffe1ff/users/bda7cd9147f04771b55eebcefe5643af/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.904906 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c79780-d3cb-405f-bc01-a58781c45d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7878c521cbf42b4a6ff60da10ffe1ff, user_id=bda7cd9147f04771b55eebcefe5643af, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:39.931053 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c79780-d3cb-405f-bc01-a58781c45d1a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:39.944080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1294/2586] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:39 2021] PUT /identity/v3/projects/a7878c521cbf42b4a6ff60da10ffe1ff/users/bda7cd9147f04771b55eebcefe5643af/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:39.955495 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f501c71-1079-4458-8117-2dbed9c11b54 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:39.955899 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f501c71-1079-4458-8117-2dbed9c11b54 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:39.956294 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f501c71-1079-4458-8117-2dbed9c11b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:39.998948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-6f501c71-1079-4458-8117-2dbed9c11b54 None None] MFA Rules not processed for user `bda7cd9147f04771b55eebcefe5643af`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:40.000130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-6f501c71-1079-4458-8117-2dbed9c11b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:40.091740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1293/2587] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:39 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:40.097207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79780-d3cb-405f-bc01-a58781c45d1a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:40.186361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79780-d3cb-405f-bc01-a58781c45d1a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:40.191415 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:40.192267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:40.192562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:40.192842 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] PATH_INFO: `/v3/users/0f65bb70b75a4023861bf1870660b6d2` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:40.194006 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f65bb70b75a4023861bf1870660b6d2)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:40.223102 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:40.285388 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f65bb70b75a4023861bf1870660b6d2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:40.301781 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f65bb70b75a4023861bf1870660b6d2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:40.303922 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f65bb70b75a4023861bf1870660b6d2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:40.315133 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f65bb70b75a4023861bf1870660b6d2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:40.327214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f65bb70b75a4023861bf1870660b6d2'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:40.335271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1295/2588] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:19:40 2021] DELETE /identity/v3/users/0f65bb70b75a4023861bf1870660b6d2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:40.339928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069794e2-7921-4880-8116-655692f6f8a3 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:40.340331 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069794e2-7921-4880-8116-655692f6f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:40.340614 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069794e2-7921-4880-8116-655692f6f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:40.370495 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-069794e2-7921-4880-8116-655692f6f8a3 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:40.371692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-069794e2-7921-4880-8116-655692f6f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:40.451025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1294/2589] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:19:40.461277 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:40.462764 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:40.544093 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223b563-15f3-4aba-8a28-7d43a40bf6d6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:40.547584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd4b27-8b7a-421b-9470-0f80d23b051b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:40.548174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd4b27-8b7a-421b-9470-0f80d23b051b service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:40.548466 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd4b27-8b7a-421b-9470-0f80d23b051b service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:40.548779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd4b27-8b7a-421b-9470-0f80d23b051b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:40.560467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd4b27-8b7a-421b-9470-0f80d23b051b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:40.587628 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd4b27-8b7a-421b-9470-0f80d23b051b service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:40.599086 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1296/2590] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:19:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:19:40.814445 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb241641-c303-4a15-8765-3cb627cfab77 None None] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:40.815738 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb241641-c303-4a15-8765-3cb627cfab77 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:40.816290 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb241641-c303-4a15-8765-3cb627cfab77 None None] PATH_INFO: `/` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:40.823160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1295/2591] 10.222.0.36 () {54 vars in 921 bytes} [Wed Oct 27 14:19:40 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:19:40.828983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feea9d-4a0b-4f19-af2c-64431a0653e0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:40.829287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feea9d-4a0b-4f19-af2c-64431a0653e0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:40.829582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feea9d-4a0b-4f19-af2c-64431a0653e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:40.869905 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-38feea9d-4a0b-4f19-af2c-64431a0653e0 None None] MFA Rules not processed for user `dea5ec2125f0468baa1e15a429021e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:40.871164 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-38feea9d-4a0b-4f19-af2c-64431a0653e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:40.878760 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1297/2592] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Oct 27 14:19:40 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:40.892072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb241641-c303-4a15-8765-3cb627cfab77 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:40.895080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fb241641-c303-4a15-8765-3cb627cfab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:40.907948 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb241641-c303-4a15-8765-3cb627cfab77 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:40.912000 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e60a78-1f4d-473b-a650-e71e4dea4806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:40.912678 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e60a78-1f4d-473b-a650-e71e4dea4806 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:40.913029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e60a78-1f4d-473b-a650-e71e4dea4806 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:40.913380 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e60a78-1f4d-473b-a650-e71e4dea4806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:40.922456 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e60a78-1f4d-473b-a650-e71e4dea4806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:40.956636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e60a78-1f4d-473b-a650-e71e4dea4806 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:40.967587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1296/2593] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:19:40 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:19:41.151004 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38feea9d-4a0b-4f19-af2c-64431a0653e0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:41.152329 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-38feea9d-4a0b-4f19-af2c-64431a0653e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:41.166983 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38feea9d-4a0b-4f19-af2c-64431a0653e0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:41.171305 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:41.172101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:41.172391 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:41.172676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] PATH_INFO: `/v3/projects/62857ab0c441461fb99b97a2e53b8321` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:41.173754 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62857ab0c441461fb99b97a2e53b8321)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:41.203593 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:41.259147 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62857ab0c441461fb99b97a2e53b8321', 'request_id': 'req-8cd17620-0669-4a07-add3-8a329de6e9d6'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.271675 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62857ab0c441461fb99b97a2e53b8321', 'request_id': 'req-8cd17620-0669-4a07-add3-8a329de6e9d6'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.279486 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62857ab0c441461fb99b97a2e53b8321', 'request_id': 'req-8cd17620-0669-4a07-add3-8a329de6e9d6'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.290400 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] The token cache is being invalidate because project 62857ab0c441461fb99b97a2e53b8321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:19:41.291072 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.291325 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.293060 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1298/2594] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:19:41 2021] DELETE /identity/v3/projects/62857ab0c441461fb99b97a2e53b8321 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:41.297015 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e60a78-1f4d-473b-a650-e71e4dea4806 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:41.310812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e60a78-1f4d-473b-a650-e71e4dea4806 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:41.375732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:41.376597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:41.376858 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:41.377111 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] PATH_INFO: `/v3/users/bda7cd9147f04771b55eebcefe5643af` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:41.379197 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda7cd9147f04771b55eebcefe5643af)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:41.414679 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:41.467759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda7cd9147f04771b55eebcefe5643af'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.479939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda7cd9147f04771b55eebcefe5643af'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.480818 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda7cd9147f04771b55eebcefe5643af'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.489796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda7cd9147f04771b55eebcefe5643af'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.497702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-2e8b3dcf-4608-4de1-874b-21a71b879d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda7cd9147f04771b55eebcefe5643af'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:41.505227 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1297/2595] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:19:41 2021] DELETE /identity/v3/users/bda7cd9147f04771b55eebcefe5643af => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:41.868616 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:41.869980 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:41.884236 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17620-0669-4a07-add3-8a329de6e9d6 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:41.947169 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:41.947934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:41.948383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:41.948801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] PATH_INFO: `/v3/projects/a7878c521cbf42b4a6ff60da10ffe1ff` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:41.950198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7878c521cbf42b4a6ff60da10ffe1ff)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:41.976988 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:42.037426 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7878c521cbf42b4a6ff60da10ffe1ff', 'request_id': 'req-6861d455-7c83-43fc-8c8c-2e705fd959cb'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:42.049030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7878c521cbf42b4a6ff60da10ffe1ff', 'request_id': 'req-6861d455-7c83-43fc-8c8c-2e705fd959cb'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:42.056361 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7878c521cbf42b4a6ff60da10ffe1ff', 'request_id': 'req-6861d455-7c83-43fc-8c8c-2e705fd959cb'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:42.067467 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] The token cache is being invalidate because project a7878c521cbf42b4a6ff60da10ffe1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:19:42.067752 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:42.068427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-6861d455-7c83-43fc-8c8c-2e705fd959cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:42.069761 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1299/2596] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:19:41 2021] DELETE /identity/v3/projects/a7878c521cbf42b4a6ff60da10ffe1ff => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:42.075556 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeffe1c-bd75-48ce-91db-2531d8a49ec4 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:42.076086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeffe1c-bd75-48ce-91db-2531d8a49ec4 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:42.076200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeffe1c-bd75-48ce-91db-2531d8a49ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:42.098695 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-0aeffe1c-bd75-48ce-91db-2531d8a49ec4 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:42.100254 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0aeffe1c-bd75-48ce-91db-2531d8a49ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:42.168012 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1298/2597] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:19:42.176416 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35f0de-5cf6-4032-9cb7-79fefe308bea None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:42.176718 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35f0de-5cf6-4032-9cb7-79fefe308bea None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:42.176987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35f0de-5cf6-4032-9cb7-79fefe308bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:42.202931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-fd35f0de-5cf6-4032-9cb7-79fefe308bea None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:42.204410 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fd35f0de-5cf6-4032-9cb7-79fefe308bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:42.215485 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1300/2598] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:19:42.220062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeffe1c-bd75-48ce-91db-2531d8a49ec4 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:42.231030 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeffe1c-bd75-48ce-91db-2531d8a49ec4 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:42.235454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a0c58-8ef8-419d-9a98-53f5d0f6485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:42.236118 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a0c58-8ef8-419d-9a98-53f5d0f6485e admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:42.236786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a0c58-8ef8-419d-9a98-53f5d0f6485e admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:42.237250 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a0c58-8ef8-419d-9a98-53f5d0f6485e admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:42.238252 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a0c58-8ef8-419d-9a98-53f5d0f6485e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:19:42.238615 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a0c58-8ef8-419d-9a98-53f5d0f6485e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:42.264067 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a0c58-8ef8-419d-9a98-53f5d0f6485e admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:42.282710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1299/2599] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:19:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:19:42.285383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35f0de-5cf6-4032-9cb7-79fefe308bea None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:42.294404 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35f0de-5cf6-4032-9cb7-79fefe308bea None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:42.299841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cf5b0-9de6-466f-8f0e-3f0e67f44ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:42.299841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf5b0-9de6-466f-8f0e-3f0e67f44ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:42.299841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf5b0-9de6-466f-8f0e-3f0e67f44ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:42.300548 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf5b0-9de6-466f-8f0e-3f0e67f44ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:42.300748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cf5b0-9de6-466f-8f0e-3f0e67f44ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:42.328144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cf5b0-9de6-466f-8f0e-3f0e67f44ff7 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:42.359589 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1301/2600] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:19:42 2021] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:42.364503 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a0c58-8ef8-419d-9a98-53f5d0f6485e admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:42.375140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a0c58-8ef8-419d-9a98-53f5d0f6485e admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:42.452893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cca14-f26e-4a2e-ae2d-da0598afb0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:42.453559 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cca14-f26e-4a2e-ae2d-da0598afb0da admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:42.453796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cca14-f26e-4a2e-ae2d-da0598afb0da admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:42.454081 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cca14-f26e-4a2e-ae2d-da0598afb0da admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:42.454750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823cca14-f26e-4a2e-ae2d-da0598afb0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:42.480913 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823cca14-f26e-4a2e-ae2d-da0598afb0da admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:42.501105 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1300/2601] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:19:42 2021] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:42.505950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cf5b0-9de6-466f-8f0e-3f0e67f44ff7 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:42.516809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cf5b0-9de6-466f-8f0e-3f0e67f44ff7 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:42.522723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d99de-3118-4050-9a6d-cdac9d4f0f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:42.523340 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d99de-3118-4050-9a6d-cdac9d4f0f0c admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:42.523709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d99de-3118-4050-9a6d-cdac9d4f0f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:42.524154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d99de-3118-4050-9a6d-cdac9d4f0f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:42.524740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d99de-3118-4050-9a6d-cdac9d4f0f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:42.551153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d99de-3118-4050-9a6d-cdac9d4f0f0c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:42.561777 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1302/2602] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:42 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:19:42.566336 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cca14-f26e-4a2e-ae2d-da0598afb0da admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:42.575817 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cca14-f26e-4a2e-ae2d-da0598afb0da admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:42.580434 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23df6c4-dfe1-4448-ba20-e10f6d6c5595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:42.581860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23df6c4-dfe1-4448-ba20-e10f6d6c5595 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:42.582147 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23df6c4-dfe1-4448-ba20-e10f6d6c5595 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:42.582497 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23df6c4-dfe1-4448-ba20-e10f6d6c5595 admin admin] PATH_INFO: `/v3/projects/a7505ea7734d43b2b0bb942fb67f06fa/users/12ab4b2a0c194456a929debdd46c1111/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:42.603149 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23df6c4-dfe1-4448-ba20-e10f6d6c5595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7505ea7734d43b2b0bb942fb67f06fa, user_id=12ab4b2a0c194456a929debdd46c1111, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:42.630312 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23df6c4-dfe1-4448-ba20-e10f6d6c5595 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:42.645507 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1301/2603] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:42 2021] PUT /identity/v3/projects/a7505ea7734d43b2b0bb942fb67f06fa/users/12ab4b2a0c194456a929debdd46c1111/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:42.657138 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599e3f8-5fa0-4401-9646-e86fd059d5d3 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:42.657797 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599e3f8-5fa0-4401-9646-e86fd059d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:42.658435 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599e3f8-5fa0-4401-9646-e86fd059d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:42.726809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-6599e3f8-5fa0-4401-9646-e86fd059d5d3 None None] MFA Rules not processed for user `12ab4b2a0c194456a929debdd46c1111`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:42.729273 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-6599e3f8-5fa0-4401-9646-e86fd059d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:42.880994 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1303/2604] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:42 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:42.885612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23df6c4-dfe1-4448-ba20-e10f6d6c5595 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:42.964668 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23df6c4-dfe1-4448-ba20-e10f6d6c5595 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:42.968837 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94afb7-433d-4042-b25d-25782f7d4e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:42.969430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94afb7-433d-4042-b25d-25782f7d4e88 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:42.969712 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94afb7-433d-4042-b25d-25782f7d4e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:42.969994 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94afb7-433d-4042-b25d-25782f7d4e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:42.970640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94afb7-433d-4042-b25d-25782f7d4e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:42.997512 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94afb7-433d-4042-b25d-25782f7d4e88 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:43.026397 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1302/2605] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:19:42 2021] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:43.030156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599e3f8-5fa0-4401-9646-e86fd059d5d3 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:43.043524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599e3f8-5fa0-4401-9646-e86fd059d5d3 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:43.112938 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3ff7d-8049-4f75-b43a-6dd4441b7c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:43.113556 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3ff7d-8049-4f75-b43a-6dd4441b7c86 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.113840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3ff7d-8049-4f75-b43a-6dd4441b7c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.114121 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3ff7d-8049-4f75-b43a-6dd4441b7c86 admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.114931 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3ff7d-8049-4f75-b43a-6dd4441b7c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:43.142084 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3ff7d-8049-4f75-b43a-6dd4441b7c86 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:43.166101 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1304/2606] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:19:43 2021] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:19:43.167347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94afb7-433d-4042-b25d-25782f7d4e88 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:43.178198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94afb7-433d-4042-b25d-25782f7d4e88 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:43.182860 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82701bf-4023-4750-b8e1-826e3c1719b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:43.183593 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82701bf-4023-4750-b8e1-826e3c1719b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.183990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82701bf-4023-4750-b8e1-826e3c1719b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.184508 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82701bf-4023-4750-b8e1-826e3c1719b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.185405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82701bf-4023-4750-b8e1-826e3c1719b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:43.210603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82701bf-4023-4750-b8e1-826e3c1719b0 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:43.223347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1303/2607] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:43 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:43.227402 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3ff7d-8049-4f75-b43a-6dd4441b7c86 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:43.239071 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3ff7d-8049-4f75-b43a-6dd4441b7c86 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:43.243387 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b35667-d537-415a-a7aa-8571df1ec737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:43.244205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35667-d537-415a-a7aa-8571df1ec737 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.244494 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35667-d537-415a-a7aa-8571df1ec737 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.244775 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35667-d537-415a-a7aa-8571df1ec737 admin admin] PATH_INFO: `/v3/projects/019d3c2b1af6413f961959360874818b/users/d929eac390ef433b8da9dacd49f5efeb/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.264939 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b35667-d537-415a-a7aa-8571df1ec737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019d3c2b1af6413f961959360874818b, user_id=d929eac390ef433b8da9dacd49f5efeb, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:43.293640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b35667-d537-415a-a7aa-8571df1ec737 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:43.308299 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1305/2608] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:43 2021] PUT /identity/v3/projects/019d3c2b1af6413f961959360874818b/users/d929eac390ef433b8da9dacd49f5efeb/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:19:43.312248 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82701bf-4023-4750-b8e1-826e3c1719b0 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:43.322597 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82701bf-4023-4750-b8e1-826e3c1719b0 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:43.398957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda5a7d-3e18-4da1-9900-a271a480f313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:43.399622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda5a7d-3e18-4da1-9900-a271a480f313 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.399953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda5a7d-3e18-4da1-9900-a271a480f313 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.400192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda5a7d-3e18-4da1-9900-a271a480f313 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.400932 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda5a7d-3e18-4da1-9900-a271a480f313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:43.428165 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda5a7d-3e18-4da1-9900-a271a480f313 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:43.442063 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1304/2609] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:43 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:43.443509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b35667-d537-415a-a7aa-8571df1ec737 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:43.454501 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b35667-d537-415a-a7aa-8571df1ec737 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:43.462772 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19fd7f-8765-4b97-9b86-6496bc097b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:43.463623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19fd7f-8765-4b97-9b86-6496bc097b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.463885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19fd7f-8765-4b97-9b86-6496bc097b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.464175 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19fd7f-8765-4b97-9b86-6496bc097b60 admin admin] PATH_INFO: `/v3/projects/019d3c2b1af6413f961959360874818b/users/d929eac390ef433b8da9dacd49f5efeb/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.465984 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19fd7f-8765-4b97-9b86-6496bc097b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019d3c2b1af6413f961959360874818b, user_id=d929eac390ef433b8da9dacd49f5efeb, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:43.476600 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda5a7d-3e18-4da1-9900-a271a480f313 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:43.478481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-bbda5a7d-3e18-4da1-9900-a271a480f313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:43.495696 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19fd7f-8765-4b97-9b86-6496bc097b60 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:43.506952 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1306/2610] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:43 2021] PUT /identity/v3/projects/019d3c2b1af6413f961959360874818b/users/d929eac390ef433b8da9dacd49f5efeb/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:43.510794 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19fd7f-8765-4b97-9b86-6496bc097b60 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:43.563345 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda5a7d-3e18-4da1-9900-a271a480f313 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:43.587227 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19fd7f-8765-4b97-9b86-6496bc097b60 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:43.591940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa93f-59bf-483d-b095-57352e263ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:43.592618 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa93f-59bf-483d-b095-57352e263ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.592979 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa93f-59bf-483d-b095-57352e263ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.593331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa93f-59bf-483d-b095-57352e263ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.594131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fa93f-59bf-483d-b095-57352e263ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:43.621040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fa93f-59bf-483d-b095-57352e263ef0 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:43.634841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1307/2611] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:43 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:43.636664 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa93f-59bf-483d-b095-57352e263ef0 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:43.648491 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:43.649095 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.649391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.649504 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa93f-59bf-483d-b095-57352e263ef0 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:43.649691 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.651373 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:43.654147 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b06df7-1cf7-42eb-8107-b231e752b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:43.655633 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b06df7-1cf7-42eb-8107-b231e752b4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.655907 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b06df7-1cf7-42eb-8107-b231e752b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.656193 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b06df7-1cf7-42eb-8107-b231e752b4ed admin admin] PATH_INFO: `/v3/projects/019d3c2b1af6413f961959360874818b/users/d929eac390ef433b8da9dacd49f5efeb/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.659987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b06df7-1cf7-42eb-8107-b231e752b4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=019d3c2b1af6413f961959360874818b, user_id=d929eac390ef433b8da9dacd49f5efeb, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:43.663061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:43.686195 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b06df7-1cf7-42eb-8107-b231e752b4ed admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:43.696151 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:43.700628 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1308/2612] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:43 2021] PUT /identity/v3/projects/019d3c2b1af6413f961959360874818b/users/d929eac390ef433b8da9dacd49f5efeb/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:19:43.702607 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1305/2613] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:19:43 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:19:43.712258 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18606545-5ff3-4a41-a9fb-71bedf523f5f None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.712553 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18606545-5ff3-4a41-a9fb-71bedf523f5f None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.713726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18606545-5ff3-4a41-a9fb-71bedf523f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.756427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-18606545-5ff3-4a41-a9fb-71bedf523f5f None None] MFA Rules not processed for user `d929eac390ef433b8da9dacd49f5efeb`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:43.756427 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-18606545-5ff3-4a41-a9fb-71bedf523f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:43.835803 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1309/2614] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:43 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:43.846084 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:43.847721 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:43.913349 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b61d9-229b-4c63-b711-07cbf37adf25 service placement] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:43.969866 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e75e-b457-494b-a05a-8362c9d06d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:43.970454 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e75e-b457-494b-a05a-8362c9d06d78 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:43.970781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e75e-b457-494b-a05a-8362c9d06d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:43.971070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e75e-b457-494b-a05a-8362c9d06d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:43.980608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619e75e-b457-494b-a05a-8362c9d06d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:44.007109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619e75e-b457-494b-a05a-8362c9d06d78 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:44.017047 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1306/2615] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:19:43 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:19:44.124723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18606545-5ff3-4a41-a9fb-71bedf523f5f None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:44.134690 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18606545-5ff3-4a41-a9fb-71bedf523f5f None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:44.137941 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d68bc6-0afe-44f0-a86d-0f6c0b9992e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:44.138516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d68bc6-0afe-44f0-a86d-0f6c0b9992e9 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:44.138845 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d68bc6-0afe-44f0-a86d-0f6c0b9992e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:44.139131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d68bc6-0afe-44f0-a86d-0f6c0b9992e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:44.204726 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d68bc6-0afe-44f0-a86d-0f6c0b9992e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:44.230943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d68bc6-0afe-44f0-a86d-0f6c0b9992e9 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:44.240986 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1310/2616] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:19:44 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:19:54.551811 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e75e-b457-494b-a05a-8362c9d06d78 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:54.620856 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e75e-b457-494b-a05a-8362c9d06d78 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:54.624964 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:54.625759 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:54.626049 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:54.626338 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] PATH_INFO: `/v3/users/12ab4b2a0c194456a929debdd46c1111` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:54.627580 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ab4b2a0c194456a929debdd46c1111)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:54.653705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:54.703732 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ab4b2a0c194456a929debdd46c1111'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:54.719270 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ab4b2a0c194456a929debdd46c1111'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:54.720029 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ab4b2a0c194456a929debdd46c1111'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:54.729943 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ab4b2a0c194456a929debdd46c1111'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:54.740187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ab4b2a0c194456a929debdd46c1111'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:54.746241 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1307/2617] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:19:54 2021] DELETE /identity/v3/users/12ab4b2a0c194456a929debdd46c1111 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:54.750614 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d2db2-d16a-4c2c-993c-09aef55b3caa None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:54.751393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d2db2-d16a-4c2c-993c-09aef55b3caa None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:54.751393 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d2db2-d16a-4c2c-993c-09aef55b3caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:54.774219 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-967d2db2-d16a-4c2c-993c-09aef55b3caa None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:54.775495 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-967d2db2-d16a-4c2c-993c-09aef55b3caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:54.846580 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1311/2618] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:54.856927 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:54.858430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:54.930844 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be863-78d1-4a75-b422-0f79cb8e97ac admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:54.935801 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a5950-2e23-41a8-a123-79e244e0413f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:54.936415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a5950-2e23-41a8-a123-79e244e0413f service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:54.936706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a5950-2e23-41a8-a123-79e244e0413f service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:54.936991 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a5950-2e23-41a8-a123-79e244e0413f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:54.951088 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a5950-2e23-41a8-a123-79e244e0413f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:54.977760 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a5950-2e23-41a8-a123-79e244e0413f service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:54.988061 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1308/2619] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:19:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:19:55.354148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d2db2-d16a-4c2c-993c-09aef55b3caa None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:55.356214 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-967d2db2-d16a-4c2c-993c-09aef55b3caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:55.368513 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d2db2-d16a-4c2c-993c-09aef55b3caa None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:55.372724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:55.373516 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:55.373805 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:55.374091 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] PATH_INFO: `/v3/projects/a7505ea7734d43b2b0bb942fb67f06fa` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:55.375185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7505ea7734d43b2b0bb942fb67f06fa)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:55.401547 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:55.463909 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7505ea7734d43b2b0bb942fb67f06fa', 'request_id': 'req-50e80078-184b-4ce2-bfd6-e347a1a59351'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.475549 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7505ea7734d43b2b0bb942fb67f06fa', 'request_id': 'req-50e80078-184b-4ce2-bfd6-e347a1a59351'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.483019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7505ea7734d43b2b0bb942fb67f06fa', 'request_id': 'req-50e80078-184b-4ce2-bfd6-e347a1a59351'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.493395 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] The token cache is being invalidate because project a7505ea7734d43b2b0bb942fb67f06fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:19:55.493676 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.494285 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.495695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1312/2620] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:19:55 2021] DELETE /identity/v3/projects/a7505ea7734d43b2b0bb942fb67f06fa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:19:55.499846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a5950-2e23-41a8-a123-79e244e0413f service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:55.509496 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a5950-2e23-41a8-a123-79e244e0413f service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:55.572828 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:55.573695 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:55.573925 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:55.574214 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] PATH_INFO: `/v3/users/d929eac390ef433b8da9dacd49f5efeb` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:55.575327 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d929eac390ef433b8da9dacd49f5efeb)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:55.602752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:55.652043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd929eac390ef433b8da9dacd49f5efeb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.663846 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd929eac390ef433b8da9dacd49f5efeb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.664481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd929eac390ef433b8da9dacd49f5efeb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.672152 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd929eac390ef433b8da9dacd49f5efeb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.679080 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-b2fc6ac6-2494-4207-8f23-ebf0df148b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd929eac390ef433b8da9dacd49f5efeb'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:55.685246 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1309/2621] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:19:55 2021] DELETE /identity/v3/users/d929eac390ef433b8da9dacd49f5efeb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:56.054577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:56.055985 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:56.069059 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e80078-184b-4ce2-bfd6-e347a1a59351 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:56.137097 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:56.137893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.138183 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.138463 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] PATH_INFO: `/v3/projects/019d3c2b1af6413f961959360874818b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.139567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=019d3c2b1af6413f961959360874818b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:56.166785 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:56.217551 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019d3c2b1af6413f961959360874818b', 'request_id': 'req-15028fab-6e48-42e6-8263-7ae0f1e88f66'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:56.229865 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019d3c2b1af6413f961959360874818b', 'request_id': 'req-15028fab-6e48-42e6-8263-7ae0f1e88f66'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:56.237243 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019d3c2b1af6413f961959360874818b', 'request_id': 'req-15028fab-6e48-42e6-8263-7ae0f1e88f66'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:56.247523 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] The token cache is being invalidate because project 019d3c2b1af6413f961959360874818b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:19:56.247835 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:56.248479 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-15028fab-6e48-42e6-8263-7ae0f1e88f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:19:56.249885 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1313/2622] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:19:56 2021] DELETE /identity/v3/projects/019d3c2b1af6413f961959360874818b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:56.257316 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aa193-79e4-4f47-947c-64b25cf7ac0c None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.257664 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aa193-79e4-4f47-947c-64b25cf7ac0c None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.257953 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aa193-79e4-4f47-947c-64b25cf7ac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.280320 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-116aa193-79e4-4f47-947c-64b25cf7ac0c None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:56.281452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-116aa193-79e4-4f47-947c-64b25cf7ac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:56.346440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1310/2623] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:56.355015 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d687f-3433-42af-b2bd-1611d02a3385 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.355314 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d687f-3433-42af-b2bd-1611d02a3385 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.355600 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d687f-3433-42af-b2bd-1611d02a3385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.377840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-9b7d687f-3433-42af-b2bd-1611d02a3385 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:56.379019 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9b7d687f-3433-42af-b2bd-1611d02a3385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:56.386137 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1314/2624] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:56.390267 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116aa193-79e4-4f47-947c-64b25cf7ac0c None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:56.399931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116aa193-79e4-4f47-947c-64b25cf7ac0c None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:56.404054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aa8aa-55b5-43ff-806c-0e61bb7b35e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:56.404633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aa8aa-55b5-43ff-806c-0e61bb7b35e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.404920 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aa8aa-55b5-43ff-806c-0e61bb7b35e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.405200 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aa8aa-55b5-43ff-806c-0e61bb7b35e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.405881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aa8aa-55b5-43ff-806c-0e61bb7b35e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:19:56.406203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aa8aa-55b5-43ff-806c-0e61bb7b35e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:56.432162 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aa8aa-55b5-43ff-806c-0e61bb7b35e4 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:56.446577 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1311/2625] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:19:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:19:56.450965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d687f-3433-42af-b2bd-1611d02a3385 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:56.460290 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d687f-3433-42af-b2bd-1611d02a3385 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:56.464538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6431211-e393-441d-87f5-cd5fa1fee6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:56.465117 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6431211-e393-441d-87f5-cd5fa1fee6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.465406 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6431211-e393-441d-87f5-cd5fa1fee6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.465688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6431211-e393-441d-87f5-cd5fa1fee6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.466322 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6431211-e393-441d-87f5-cd5fa1fee6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:56.492649 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6431211-e393-441d-87f5-cd5fa1fee6f3 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:56.519351 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1315/2626] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:19:56 2021] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:56.524277 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aa8aa-55b5-43ff-806c-0e61bb7b35e4 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:56.533779 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aa8aa-55b5-43ff-806c-0e61bb7b35e4 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:56.602806 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c160a-1648-407c-bf56-970da9491a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:56.603473 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c160a-1648-407c-bf56-970da9491a38 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.603699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c160a-1648-407c-bf56-970da9491a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.603985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c160a-1648-407c-bf56-970da9491a38 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.604627 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c160a-1648-407c-bf56-970da9491a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:56.630931 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c160a-1648-407c-bf56-970da9491a38 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:56.650895 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1312/2627] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:19:56 2021] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:19:56.655047 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6431211-e393-441d-87f5-cd5fa1fee6f3 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:56.664841 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6431211-e393-441d-87f5-cd5fa1fee6f3 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:56.669064 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a24439-a9d8-4a11-8f82-bd3fc0e24166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:56.669642 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a24439-a9d8-4a11-8f82-bd3fc0e24166 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.669929 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a24439-a9d8-4a11-8f82-bd3fc0e24166 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.670208 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a24439-a9d8-4a11-8f82-bd3fc0e24166 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.670927 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a24439-a9d8-4a11-8f82-bd3fc0e24166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:56.696338 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a24439-a9d8-4a11-8f82-bd3fc0e24166 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:56.706478 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1316/2628] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:56 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:56.711612 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c160a-1648-407c-bf56-970da9491a38 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:56.720961 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c160a-1648-407c-bf56-970da9491a38 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:56.725401 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ca366-391c-44e2-94c8-edacab0c1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:56.726204 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ca366-391c-44e2-94c8-edacab0c1099 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.726488 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ca366-391c-44e2-94c8-edacab0c1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.726812 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ca366-391c-44e2-94c8-edacab0c1099 admin admin] PATH_INFO: `/v3/projects/99afe5f2b4e24c17bd9f0419e27307e4/users/59965d255a554d28802b08483010faf1/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.747096 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ca366-391c-44e2-94c8-edacab0c1099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99afe5f2b4e24c17bd9f0419e27307e4, user_id=59965d255a554d28802b08483010faf1, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:56.775001 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ca366-391c-44e2-94c8-edacab0c1099 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:56.788025 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1313/2629] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:56 2021] PUT /identity/v3/projects/99afe5f2b4e24c17bd9f0419e27307e4/users/59965d255a554d28802b08483010faf1/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:56.798198 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec137b-e05b-40fe-abb6-dfcb49677727 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.798489 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec137b-e05b-40fe-abb6-dfcb49677727 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.798809 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec137b-e05b-40fe-abb6-dfcb49677727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.835792 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-3aec137b-e05b-40fe-abb6-dfcb49677727 None None] MFA Rules not processed for user `59965d255a554d28802b08483010faf1`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:56.836943 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-3aec137b-e05b-40fe-abb6-dfcb49677727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:56.911702 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1317/2630] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:56 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:56.916307 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ca366-391c-44e2-94c8-edacab0c1099 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:56.985741 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ca366-391c-44e2-94c8-edacab0c1099 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:56.990826 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60854295-9469-4a25-a33a-0dbfc9207ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:56.991571 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60854295-9469-4a25-a33a-0dbfc9207ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:56.991706 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60854295-9469-4a25-a33a-0dbfc9207ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:56.992011 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60854295-9469-4a25-a33a-0dbfc9207ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:56.992594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60854295-9469-4a25-a33a-0dbfc9207ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.018820 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60854295-9469-4a25-a33a-0dbfc9207ec3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:57.045713 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1314/2631] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:19:56 2021] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:57.049723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec137b-e05b-40fe-abb6-dfcb49677727 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:57.060660 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec137b-e05b-40fe-abb6-dfcb49677727 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:57.125756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34d61c-78fd-4005-bec3-81950ef7877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:57.126358 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34d61c-78fd-4005-bec3-81950ef7877e admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.126671 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34d61c-78fd-4005-bec3-81950ef7877e admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.126961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34d61c-78fd-4005-bec3-81950ef7877e admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.127591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34d61c-78fd-4005-bec3-81950ef7877e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.153493 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34d61c-78fd-4005-bec3-81950ef7877e admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:57.172282 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1318/2632] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:19:57 2021] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:57.176977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60854295-9469-4a25-a33a-0dbfc9207ec3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:57.186615 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60854295-9469-4a25-a33a-0dbfc9207ec3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:57.190709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b652e33-758e-4ef7-886a-72de39ea4234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:57.191292 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b652e33-758e-4ef7-886a-72de39ea4234 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.191663 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b652e33-758e-4ef7-886a-72de39ea4234 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.192452 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b652e33-758e-4ef7-886a-72de39ea4234 admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.193130 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b652e33-758e-4ef7-886a-72de39ea4234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.218352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b652e33-758e-4ef7-886a-72de39ea4234 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:57.229369 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1315/2633] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:57 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:57.233510 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34d61c-78fd-4005-bec3-81950ef7877e admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:57.243888 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34d61c-78fd-4005-bec3-81950ef7877e admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:57.248302 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4bc2-2a99-43e3-b82f-1b98dc8bedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:57.249111 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4bc2-2a99-43e3-b82f-1b98dc8bedb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.249433 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4bc2-2a99-43e3-b82f-1b98dc8bedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.249717 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4bc2-2a99-43e3-b82f-1b98dc8bedb2 admin admin] PATH_INFO: `/v3/projects/35bf4ceb4c0b4fb08f00cb51a632c7b0/users/a9e69ef1301e416a85ed4496663e870e/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.270076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4bc2-2a99-43e3-b82f-1b98dc8bedb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bf4ceb4c0b4fb08f00cb51a632c7b0, user_id=a9e69ef1301e416a85ed4496663e870e, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.296078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4bc2-2a99-43e3-b82f-1b98dc8bedb2 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:57.309524 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1319/2634] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:57 2021] PUT /identity/v3/projects/35bf4ceb4c0b4fb08f00cb51a632c7b0/users/a9e69ef1301e416a85ed4496663e870e/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:57.321415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8597d46-31cc-4e25-a1ff-418d1b154de7 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.321715 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8597d46-31cc-4e25-a1ff-418d1b154de7 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.322004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8597d46-31cc-4e25-a1ff-418d1b154de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.358087 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-e8597d46-31cc-4e25-a1ff-418d1b154de7 None None] MFA Rules not processed for user `a9e69ef1301e416a85ed4496663e870e`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:57.359262 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-e8597d46-31cc-4e25-a1ff-418d1b154de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:57.430134 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1316/2635] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:57 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:19:57.434757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4bc2-2a99-43e3-b82f-1b98dc8bedb2 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:57.506403 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4bc2-2a99-43e3-b82f-1b98dc8bedb2 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:57.510743 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae188c9-b3f9-4303-b689-a29ab7ba73f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:57.511343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae188c9-b3f9-4303-b689-a29ab7ba73f9 admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.511635 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae188c9-b3f9-4303-b689-a29ab7ba73f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.511924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae188c9-b3f9-4303-b689-a29ab7ba73f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.512562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae188c9-b3f9-4303-b689-a29ab7ba73f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.538682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae188c9-b3f9-4303-b689-a29ab7ba73f9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:57.565442 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1320/2636] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:19:57 2021] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:57.569634 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8597d46-31cc-4e25-a1ff-418d1b154de7 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:57.579739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8597d46-31cc-4e25-a1ff-418d1b154de7 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:57.643144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae66b-3511-4d0e-ab68-8271e4f385db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:57.643807 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae66b-3511-4d0e-ab68-8271e4f385db admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.644009 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae66b-3511-4d0e-ab68-8271e4f385db admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.644289 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae66b-3511-4d0e-ab68-8271e4f385db admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.645018 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae66b-3511-4d0e-ab68-8271e4f385db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.671274 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae66b-3511-4d0e-ab68-8271e4f385db admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:57.691888 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1317/2637] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:19:57 2021] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:19:57.695537 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae188c9-b3f9-4303-b689-a29ab7ba73f9 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:57.705159 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae188c9-b3f9-4303-b689-a29ab7ba73f9 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:57.709744 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd805479-602f-47c7-ab7e-1997b1387dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:57.710324 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd805479-602f-47c7-ab7e-1997b1387dac admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.710611 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd805479-602f-47c7-ab7e-1997b1387dac admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.710920 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd805479-602f-47c7-ab7e-1997b1387dac admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.711601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd805479-602f-47c7-ab7e-1997b1387dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.737518 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd805479-602f-47c7-ab7e-1997b1387dac admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:57.748688 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1321/2638] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:57 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:57.752924 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae66b-3511-4d0e-ab68-8271e4f385db admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:57.762464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae66b-3511-4d0e-ab68-8271e4f385db admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:57.766726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a5233-c591-4e3e-b8b7-81a2307b577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:57.767535 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a5233-c591-4e3e-b8b7-81a2307b577b admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.767829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a5233-c591-4e3e-b8b7-81a2307b577b admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.768117 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a5233-c591-4e3e-b8b7-81a2307b577b admin admin] PATH_INFO: `/v3/projects/3f07e213dd60416797e09fa2bccabe4b/users/14dad252de9f46ec95d763aa19a60711/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.789399 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a5233-c591-4e3e-b8b7-81a2307b577b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f07e213dd60416797e09fa2bccabe4b, user_id=14dad252de9f46ec95d763aa19a60711, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.815523 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a5233-c591-4e3e-b8b7-81a2307b577b admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:57.828869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1318/2639] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:57 2021] PUT /identity/v3/projects/3f07e213dd60416797e09fa2bccabe4b/users/14dad252de9f46ec95d763aa19a60711/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:19:57.833455 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd805479-602f-47c7-ab7e-1997b1387dac admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:57.843079 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd805479-602f-47c7-ab7e-1997b1387dac admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:57.905446 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17f67-a551-4ea1-80b3-239d947ad22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:57.906046 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17f67-a551-4ea1-80b3-239d947ad22f admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.906341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17f67-a551-4ea1-80b3-239d947ad22f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.906663 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf17f67-a551-4ea1-80b3-239d947ad22f admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.907345 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17f67-a551-4ea1-80b3-239d947ad22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.933127 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf17f67-a551-4ea1-80b3-239d947ad22f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:57.943601 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1322/2640] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:57 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:57.947734 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a5233-c591-4e3e-b8b7-81a2307b577b admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:57.957865 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a5233-c591-4e3e-b8b7-81a2307b577b admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:57.962242 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc3e2e-3ca2-4feb-92a7-f55bd93f2cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:57.963085 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc3e2e-3ca2-4feb-92a7-f55bd93f2cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:57.963374 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc3e2e-3ca2-4feb-92a7-f55bd93f2cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:57.963657 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc3e2e-3ca2-4feb-92a7-f55bd93f2cf3 admin admin] PATH_INFO: `/v3/projects/3f07e213dd60416797e09fa2bccabe4b/users/14dad252de9f46ec95d763aa19a60711/roles/61b5c8d35a4340cc8763596e0d938bf0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:57.965395 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc3e2e-3ca2-4feb-92a7-f55bd93f2cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f07e213dd60416797e09fa2bccabe4b, user_id=14dad252de9f46ec95d763aa19a60711, role_id=61b5c8d35a4340cc8763596e0d938bf0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:57.992959 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc3e2e-3ca2-4feb-92a7-f55bd93f2cf3 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:58.004513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1319/2641] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:57 2021] PUT /identity/v3/projects/3f07e213dd60416797e09fa2bccabe4b/users/14dad252de9f46ec95d763aa19a60711/roles/61b5c8d35a4340cc8763596e0d938bf0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:19:58.008429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17f67-a551-4ea1-80b3-239d947ad22f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:58.018080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf17f67-a551-4ea1-80b3-239d947ad22f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:58.084107 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a89fe9-7147-48e5-98e8-9e6a1bee88c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:58.084779 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89fe9-7147-48e5-98e8-9e6a1bee88c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:58.084893 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89fe9-7147-48e5-98e8-9e6a1bee88c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:58.085161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a89fe9-7147-48e5-98e8-9e6a1bee88c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:58.085851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89fe9-7147-48e5-98e8-9e6a1bee88c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:58.111010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a89fe9-7147-48e5-98e8-9e6a1bee88c5 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:58.121597 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1323/2642] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:19:58.125949 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc3e2e-3ca2-4feb-92a7-f55bd93f2cf3 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:58.136176 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc3e2e-3ca2-4feb-92a7-f55bd93f2cf3 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:58.140340 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c988760-4fa0-4643-b2ba-265e6a31d787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:58.141144 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c988760-4fa0-4643-b2ba-265e6a31d787 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:58.141433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c988760-4fa0-4643-b2ba-265e6a31d787 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:58.141718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c988760-4fa0-4643-b2ba-265e6a31d787 admin admin] PATH_INFO: `/v3/projects/3f07e213dd60416797e09fa2bccabe4b/users/14dad252de9f46ec95d763aa19a60711/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:58.143494 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c988760-4fa0-4643-b2ba-265e6a31d787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f07e213dd60416797e09fa2bccabe4b, user_id=14dad252de9f46ec95d763aa19a60711, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:58.170062 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c988760-4fa0-4643-b2ba-265e6a31d787 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:58.183969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1320/2643] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:19:58 2021] PUT /identity/v3/projects/3f07e213dd60416797e09fa2bccabe4b/users/14dad252de9f46ec95d763aa19a60711/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:19:58.195454 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97082a-c4a6-4f38-884e-485e0cf980db None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:58.195748 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97082a-c4a6-4f38-884e-485e0cf980db None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:58.196031 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97082a-c4a6-4f38-884e-485e0cf980db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:58.232268 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-2f97082a-c4a6-4f38-884e-485e0cf980db None None] MFA Rules not processed for user `14dad252de9f46ec95d763aa19a60711`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:19:58.233430 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2f97082a-c4a6-4f38-884e-485e0cf980db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:58.310640 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1324/2644] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:19:58 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:19:58.320718 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c988760-4fa0-4643-b2ba-265e6a31d787 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:58.322286 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7c988760-4fa0-4643-b2ba-265e6a31d787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:58.385487 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c988760-4fa0-4643-b2ba-265e6a31d787 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:58.388893 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1363e-be43-472d-8335-bd36a60897de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:58.389478 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1363e-be43-472d-8335-bd36a60897de service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:58.389765 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1363e-be43-472d-8335-bd36a60897de service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:58.390048 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1363e-be43-472d-8335-bd36a60897de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:58.399405 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1363e-be43-472d-8335-bd36a60897de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:58.424106 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1363e-be43-472d-8335-bd36a60897de service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:58.433317 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1321/2645] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:19:58 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:19:59.023514 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97082a-c4a6-4f38-884e-485e0cf980db None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:19:59.024877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2f97082a-c4a6-4f38-884e-485e0cf980db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:19:59.038966 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97082a-c4a6-4f38-884e-485e0cf980db None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:19:59.042271 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eff358-b2db-44cd-a8d6-519ecadbb5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:19:59.042894 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eff358-b2db-44cd-a8d6-519ecadbb5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:19:59.043181 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eff358-b2db-44cd-a8d6-519ecadbb5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:19:59.043464 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eff358-b2db-44cd-a8d6-519ecadbb5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:19:59.119704 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eff358-b2db-44cd-a8d6-519ecadbb5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:19:59.150383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eff358-b2db-44cd-a8d6-519ecadbb5d8 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:19:59.160221 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1325/2646] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:19:59 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:20:03.793382 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1363e-be43-472d-8335-bd36a60897de service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:03.803392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1363e-be43-472d-8335-bd36a60897de service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:03.806833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17ec76-64a7-4fc3-a68a-55891b4c1a6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:03.807406 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ec76-64a7-4fc3-a68a-55891b4c1a6b service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:03.807699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ec76-64a7-4fc3-a68a-55891b4c1a6b service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:03.807985 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ec76-64a7-4fc3-a68a-55891b4c1a6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:03.877104 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17ec76-64a7-4fc3-a68a-55891b4c1a6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:03.903969 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17ec76-64a7-4fc3-a68a-55891b4c1a6b service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:03.914054 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1322/2647] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:20:03 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:20:06.460380 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eff358-b2db-44cd-a8d6-519ecadbb5d8 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:06.565932 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eff358-b2db-44cd-a8d6-519ecadbb5d8 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:06.572026 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:06.572864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:06.573153 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:06.573493 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] PATH_INFO: `/v3/users/59965d255a554d28802b08483010faf1` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:06.574605 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59965d255a554d28802b08483010faf1)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:06.602706 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:06.658384 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59965d255a554d28802b08483010faf1'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:06.671475 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59965d255a554d28802b08483010faf1'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:06.672186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59965d255a554d28802b08483010faf1'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:06.680550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59965d255a554d28802b08483010faf1'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:06.688284 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59965d255a554d28802b08483010faf1'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:06.695139 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1326/2648] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:20:06 2021] DELETE /identity/v3/users/59965d255a554d28802b08483010faf1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:20:06.699591 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8333cc-17b5-4876-91ff-aec0f41eae50 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:06.700079 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8333cc-17b5-4876-91ff-aec0f41eae50 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:06.700187 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8333cc-17b5-4876-91ff-aec0f41eae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:06.723658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-4a8333cc-17b5-4876-91ff-aec0f41eae50 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:06.724761 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4a8333cc-17b5-4876-91ff-aec0f41eae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:06.793205 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1323/2649] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:06.804177 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:06.805543 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:06.871367 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7234734-77da-465a-9038-41986a5d1b1f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:06.874899 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52d9c-3d02-4469-bb0f-a67208d660b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:06.875480 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52d9c-3d02-4469-bb0f-a67208d660b1 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:06.875771 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52d9c-3d02-4469-bb0f-a67208d660b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:06.876057 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52d9c-3d02-4469-bb0f-a67208d660b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:06.886078 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a52d9c-3d02-4469-bb0f-a67208d660b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:06.912157 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a52d9c-3d02-4469-bb0f-a67208d660b1 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:06.922536 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1327/2650] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:20:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:20:07.363097 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8333cc-17b5-4876-91ff-aec0f41eae50 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:07.364753 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-4a8333cc-17b5-4876-91ff-aec0f41eae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:07.376229 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8333cc-17b5-4876-91ff-aec0f41eae50 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:07.381404 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:07.382230 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:07.382710 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:07.383396 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] PATH_INFO: `/v3/projects/99afe5f2b4e24c17bd9f0419e27307e4` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:07.384074 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99afe5f2b4e24c17bd9f0419e27307e4)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:07.412125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:07.464099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99afe5f2b4e24c17bd9f0419e27307e4', 'request_id': 'req-72816978-a9a4-4763-871b-6fbc7f7b97b1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.474974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99afe5f2b4e24c17bd9f0419e27307e4', 'request_id': 'req-72816978-a9a4-4763-871b-6fbc7f7b97b1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.482139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99afe5f2b4e24c17bd9f0419e27307e4', 'request_id': 'req-72816978-a9a4-4763-871b-6fbc7f7b97b1'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.493236 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] The token cache is being invalidate because project 99afe5f2b4e24c17bd9f0419e27307e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:20:07.493651 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.494376 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.496560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1324/2651] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:20:07 2021] DELETE /identity/v3/projects/99afe5f2b4e24c17bd9f0419e27307e4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:20:07.500465 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52d9c-3d02-4469-bb0f-a67208d660b1 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:07.510855 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52d9c-3d02-4469-bb0f-a67208d660b1 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:07.578156 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:07.579028 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:07.579315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:07.579591 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] PATH_INFO: `/v3/users/a9e69ef1301e416a85ed4496663e870e` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:07.580686 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e69ef1301e416a85ed4496663e870e)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:07.606757 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:07.657969 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e69ef1301e416a85ed4496663e870e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.671878 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e69ef1301e416a85ed4496663e870e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.672711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e69ef1301e416a85ed4496663e870e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.682507 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e69ef1301e416a85ed4496663e870e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.691331 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e69ef1301e416a85ed4496663e870e'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:07.698831 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1328/2652] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:20:07 2021] DELETE /identity/v3/users/a9e69ef1301e416a85ed4496663e870e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:20:08.070653 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:08.072158 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:08.084513 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72816978-a9a4-4763-871b-6fbc7f7b97b1 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:08.150330 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:08.151160 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:08.151450 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:08.151740 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] PATH_INFO: `/v3/projects/35bf4ceb4c0b4fb08f00cb51a632c7b0` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:08.152813 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] RBAC: Authorizing `identity:delete_project(project_id=35bf4ceb4c0b4fb08f00cb51a632c7b0)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:08.178314 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:08.228351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35bf4ceb4c0b4fb08f00cb51a632c7b0', 'request_id': 'req-a03b5309-ea86-4153-8a63-088f258b293f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.240346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35bf4ceb4c0b4fb08f00cb51a632c7b0', 'request_id': 'req-a03b5309-ea86-4153-8a63-088f258b293f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.247390 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35bf4ceb4c0b4fb08f00cb51a632c7b0', 'request_id': 'req-a03b5309-ea86-4153-8a63-088f258b293f'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.258055 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] The token cache is being invalidate because project 35bf4ceb4c0b4fb08f00cb51a632c7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:20:08.258346 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.258963 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.260414 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1325/2653] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:20:08 2021] DELETE /identity/v3/projects/35bf4ceb4c0b4fb08f00cb51a632c7b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:20:08.264557 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:08.265910 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:08.278342 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026155b-884f-4bf8-809e-3c6ddc577712 admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:08.344958 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:08.345770 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:08.346062 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:08.346348 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] PATH_INFO: `/v3/users/14dad252de9f46ec95d763aa19a60711` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:08.347520 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14dad252de9f46ec95d763aa19a60711)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:08.374383 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:08.423105 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14dad252de9f46ec95d763aa19a60711'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.435052 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14dad252de9f46ec95d763aa19a60711'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.436021 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14dad252de9f46ec95d763aa19a60711'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.444382 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14dad252de9f46ec95d763aa19a60711'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.451211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-43ada5cb-c589-4181-a617-7cf6f0b56bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14dad252de9f46ec95d763aa19a60711'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.457070 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1329/2654] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:20:08 2021] DELETE /identity/v3/users/14dad252de9f46ec95d763aa19a60711 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:20:08.824264 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:08.826036 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:08.840168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b5309-ea86-4153-8a63-088f258b293f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:08.904595 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:08.905423 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:08.905821 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:08.905998 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] PATH_INFO: `/v3/projects/3f07e213dd60416797e09fa2bccabe4b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:08.907112 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f07e213dd60416797e09fa2bccabe4b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:08.933594 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:08.984123 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f07e213dd60416797e09fa2bccabe4b', 'request_id': 'req-d350c597-4f49-485b-bf10-0dc4d79cde7a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:08.996113 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f07e213dd60416797e09fa2bccabe4b', 'request_id': 'req-d350c597-4f49-485b-bf10-0dc4d79cde7a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:09.003072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f07e213dd60416797e09fa2bccabe4b', 'request_id': 'req-d350c597-4f49-485b-bf10-0dc4d79cde7a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:09.013585 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] The token cache is being invalidate because project 3f07e213dd60416797e09fa2bccabe4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:20:09.013876 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:09.014469 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-d350c597-4f49-485b-bf10-0dc4d79cde7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:09.015981 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1326/2655] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:20:08 2021] DELETE /identity/v3/projects/3f07e213dd60416797e09fa2bccabe4b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:20:09.028572 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f9ac1-7e85-40bd-bb94-90c317c4da1d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.029022 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f9ac1-7e85-40bd-bb94-90c317c4da1d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.029296 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f9ac1-7e85-40bd-bb94-90c317c4da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.054955 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-a65f9ac1-7e85-40bd-bb94-90c317c4da1d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:09.056186 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-a65f9ac1-7e85-40bd-bb94-90c317c4da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:09.122056 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1330/2656] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:09.131789 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500945-0d56-42b9-9f3e-141ad6d5fb39 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.132389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500945-0d56-42b9-9f3e-141ad6d5fb39 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.132389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500945-0d56-42b9-9f3e-141ad6d5fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.155392 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-68500945-0d56-42b9-9f3e-141ad6d5fb39 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:09.156568 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-68500945-0d56-42b9-9f3e-141ad6d5fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:09.164240 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1327/2657] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:09.168571 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f9ac1-7e85-40bd-bb94-90c317c4da1d None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:09.177840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f9ac1-7e85-40bd-bb94-90c317c4da1d None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:09.182041 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508a31-b03f-4f67-9d29-e5e33099cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:09.182641 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508a31-b03f-4f67-9d29-e5e33099cf3a admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.182934 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508a31-b03f-4f67-9d29-e5e33099cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.183220 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508a31-b03f-4f67-9d29-e5e33099cf3a admin admin] PATH_INFO: `/v3/domains` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.183897 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508a31-b03f-4f67-9d29-e5e33099cf3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66092) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:20:09.184197 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508a31-b03f-4f67-9d29-e5e33099cf3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:09.209728 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508a31-b03f-4f67-9d29-e5e33099cf3a admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:09.222577 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1331/2658] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:20:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:20:09.228258 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500945-0d56-42b9-9f3e-141ad6d5fb39 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:09.237379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500945-0d56-42b9-9f3e-141ad6d5fb39 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:09.241576 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78775648-ef83-4997-b00a-6cb8a2480ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:09.242156 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78775648-ef83-4997-b00a-6cb8a2480ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.242444 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78775648-ef83-4997-b00a-6cb8a2480ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.242750 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78775648-ef83-4997-b00a-6cb8a2480ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.243391 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78775648-ef83-4997-b00a-6cb8a2480ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:09.268781 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78775648-ef83-4997-b00a-6cb8a2480ea5 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:09.296320 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1328/2659] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:20:09 2021] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:20:09.300623 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508a31-b03f-4f67-9d29-e5e33099cf3a admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:09.310508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508a31-b03f-4f67-9d29-e5e33099cf3a admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:09.374166 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775bfe3-9b22-4b38-a2b7-073c4fe2846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:09.374810 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775bfe3-9b22-4b38-a2b7-073c4fe2846c admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.375106 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775bfe3-9b22-4b38-a2b7-073c4fe2846c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.375423 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775bfe3-9b22-4b38-a2b7-073c4fe2846c admin admin] PATH_INFO: `/v3/users` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.376066 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775bfe3-9b22-4b38-a2b7-073c4fe2846c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:09.402987 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775bfe3-9b22-4b38-a2b7-073c4fe2846c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:09.427603 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1332/2660] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:20:09 2021] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:20:09.431579 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78775648-ef83-4997-b00a-6cb8a2480ea5 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:09.441120 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775bfe3-9b22-4b38-a2b7-073c4fe2846c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:09.443724 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-2775bfe3-9b22-4b38-a2b7-073c4fe2846c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:09.444192 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78775648-ef83-4997-b00a-6cb8a2480ea5 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:09.448989 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f215-1283-44c2-baba-4e0b4f0f5a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:09.449674 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f215-1283-44c2-baba-4e0b4f0f5a3f admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.450140 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f215-1283-44c2-baba-4e0b4f0f5a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.450610 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f215-1283-44c2-baba-4e0b4f0f5a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.451389 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f215-1283-44c2-baba-4e0b4f0f5a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:09.477711 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f215-1283-44c2-baba-4e0b4f0f5a3f admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:09.492019 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1329/2661] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:20:09 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:20:09.493139 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f215-1283-44c2-baba-4e0b4f0f5a3f admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:09.504902 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f215-1283-44c2-baba-4e0b4f0f5a3f admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:09.510481 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c29920-1385-44f9-b685-2a8cc08c7f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:09.511347 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29920-1385-44f9-b685-2a8cc08c7f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.511640 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29920-1385-44f9-b685-2a8cc08c7f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.511957 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29920-1385-44f9-b685-2a8cc08c7f25 admin admin] PATH_INFO: `/v3/projects/d6219d8fce854b67bb4d23062ba3e29d/users/115ba37462b14544b90ac9e5ea0ebf5c/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.514839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775bfe3-9b22-4b38-a2b7-073c4fe2846c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:09.518946 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:09.519523 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.520582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.521001 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.522948 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:09.536940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c29920-1385-44f9-b685-2a8cc08c7f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6219d8fce854b67bb4d23062ba3e29d, user_id=115ba37462b14544b90ac9e5ea0ebf5c, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:09.568228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c29920-1385-44f9-b685-2a8cc08c7f25 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:09.592251 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1330/2662] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:20:09 2021] PUT /identity/v3/projects/d6219d8fce854b67bb4d23062ba3e29d/users/115ba37462b14544b90ac9e5ea0ebf5c/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:20:09.594603 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17791a0-9b96-4544-a1d8-4844a4831c0b None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.595057 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17791a0-9b96-4544-a1d8-4844a4831c0b None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.595446 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17791a0-9b96-4544-a1d8-4844a4831c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.606140 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:09.634012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:09.646125 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-d17791a0-9b96-4544-a1d8-4844a4831c0b None None] MFA Rules not processed for user `115ba37462b14544b90ac9e5ea0ebf5c`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:09.647280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-d17791a0-9b96-4544-a1d8-4844a4831c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:09.650709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1333/2663] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:20:09 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:20:09.724773 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1331/2664] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:09 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:09.739027 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:09.740965 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:09.822246 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf87e8-54fe-436b-996b-bae11c0a74d9 service cinder] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:09.891185 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c2e8d-1ebc-4cbb-9fe7-31ed4bf770c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ddc229d1a0446c83956f9f0c1ddbfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:09.892161 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2e8d-1ebc-4cbb-9fe7-31ed4bf770c6 service glance] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:09.893647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2e8d-1ebc-4cbb-9fe7-31ed4bf770c6 service glance] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:09.895901 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2e8d-1ebc-4cbb-9fe7-31ed4bf770c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:09.910697 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c2e8d-1ebc-4cbb-9fe7-31ed4bf770c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:09.937211 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c2e8d-1ebc-4cbb-9fe7-31ed4bf770c6 service glance] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:09.947448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1334/2665] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:20:09 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:20:12.450371 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145626d1-6c11-47a8-87ac-12b419ac3783 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:12.450936 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145626d1-6c11-47a8-87ac-12b419ac3783 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:12.451044 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145626d1-6c11-47a8-87ac-12b419ac3783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:12.474531 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-145626d1-6c11-47a8-87ac-12b419ac3783 None None] MFA Rules not processed for user `18862da5aa3c4d0f8395f600af08489f`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:12.475714 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-145626d1-6c11-47a8-87ac-12b419ac3783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:12.539714 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1332/2666] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:12 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:17.329587 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e8fd0-1216-4f01-8ca7-4394e5b47e5d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:17.330090 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e8fd0-1216-4f01-8ca7-4394e5b47e5d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:17.330174 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e8fd0-1216-4f01-8ca7-4394e5b47e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:17.353294 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-393e8fd0-1216-4f01-8ca7-4394e5b47e5d None None] MFA Rules not processed for user `884b2c83926146828276418e0101925f`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:17.354448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-393e8fd0-1216-4f01-8ca7-4394e5b47e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:17.419163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1335/2667] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:17 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:44.106575 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145626d1-6c11-47a8-87ac-12b419ac3783 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:44.180177 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145626d1-6c11-47a8-87ac-12b419ac3783 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:44.184337 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:44.185127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:44.185415 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:44.185696 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] PATH_INFO: `/v3/users/115ba37462b14544b90ac9e5ea0ebf5c` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:44.186785 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=115ba37462b14544b90ac9e5ea0ebf5c)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:44.212974 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:44.262004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115ba37462b14544b90ac9e5ea0ebf5c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:44.273645 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115ba37462b14544b90ac9e5ea0ebf5c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:44.274226 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115ba37462b14544b90ac9e5ea0ebf5c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:44.281709 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115ba37462b14544b90ac9e5ea0ebf5c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:44.288684 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115ba37462b14544b90ac9e5ea0ebf5c'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:44.296323 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1333/2668] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:20:44 2021] DELETE /identity/v3/users/115ba37462b14544b90ac9e5ea0ebf5c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:20:44.300846 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ebe7d-ee31-404d-b0d1-1373ca18e466 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:44.301362 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ebe7d-ee31-404d-b0d1-1373ca18e466 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:44.301472 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ebe7d-ee31-404d-b0d1-1373ca18e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:44.323840 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-ab8ebe7d-ee31-404d-b0d1-1373ca18e466 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:44.325010 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ab8ebe7d-ee31-404d-b0d1-1373ca18e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:44.389270 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1336/2669] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:44.399923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:44.401228 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:44.465636 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fe18-f243-4fa7-b3c8-0e0df20186b2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:44.469043 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0818b-7649-48b4-be82-c018e120d8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:44.469625 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0818b-7649-48b4-be82-c018e120d8ff service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:44.469917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0818b-7649-48b4-be82-c018e120d8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:44.470206 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0818b-7649-48b4-be82-c018e120d8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:44.479280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0818b-7649-48b4-be82-c018e120d8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:44.505168 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0818b-7649-48b4-be82-c018e120d8ff service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:44.515825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1334/2670] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:20:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:20:44.878497 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ebe7d-ee31-404d-b0d1-1373ca18e466 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:44.879863 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-ab8ebe7d-ee31-404d-b0d1-1373ca18e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:44.892162 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ebe7d-ee31-404d-b0d1-1373ca18e466 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:44.897285 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:44.898267 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:44.898608 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:44.898882 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] PATH_INFO: `/v3/projects/d6219d8fce854b67bb4d23062ba3e29d` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:44.899963 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6219d8fce854b67bb4d23062ba3e29d)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:44.926237 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:44.982160 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6219d8fce854b67bb4d23062ba3e29d', 'request_id': 'req-eab1e2fb-0963-4670-a0be-73d9668e82e9'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:44.994334 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6219d8fce854b67bb4d23062ba3e29d', 'request_id': 'req-eab1e2fb-0963-4670-a0be-73d9668e82e9'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:45.002707 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6219d8fce854b67bb4d23062ba3e29d', 'request_id': 'req-eab1e2fb-0963-4670-a0be-73d9668e82e9'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:45.014735 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] The token cache is being invalidate because project d6219d8fce854b67bb4d23062ba3e29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66092) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:20:45.015024 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:45.015647 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-eab1e2fb-0963-4670-a0be-73d9668e82e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:20:45.017054 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1337/2671] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:20:44 2021] DELETE /identity/v3/projects/d6219d8fce854b67bb4d23062ba3e29d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:20:45.022908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd0767-dece-4c1c-99e8-351180f1e968 None None] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:45.023411 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd0767-dece-4c1c-99e8-351180f1e968 None None] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:45.023648 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd0767-dece-4c1c-99e8-351180f1e968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:45.046767 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.auth.core [None req-3cbd0767-dece-4c1c-99e8-351180f1e968 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66091) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:45.047935 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-3cbd0767-dece-4c1c-99e8-351180f1e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:45.117652 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1335/2672] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:45.125958 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31f04-7fba-46c3-a1e0-625b9ed7d9d0 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:45.126259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31f04-7fba-46c3-a1e0-625b9ed7d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:45.126544 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31f04-7fba-46c3-a1e0-625b9ed7d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:45.150917 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-85a31f04-7fba-46c3-a1e0-625b9ed7d9d0 None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:45.152034 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-85a31f04-7fba-46c3-a1e0-625b9ed7d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:45.158961 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1338/2673] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:20:45.163447 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd0767-dece-4c1c-99e8-351180f1e968 None None] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:45.172622 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd0767-dece-4c1c-99e8-351180f1e968 None None] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:45.177090 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e93cfb-40dd-4847-8aea-02516f790ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:45.177692 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e93cfb-40dd-4847-8aea-02516f790ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:45.177988 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e93cfb-40dd-4847-8aea-02516f790ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:45.178270 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e93cfb-40dd-4847-8aea-02516f790ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:45.179527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e93cfb-40dd-4847-8aea-02516f790ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66091) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:20:45.179829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e93cfb-40dd-4847-8aea-02516f790ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:45.205786 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e93cfb-40dd-4847-8aea-02516f790ea8 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:45.218951 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1336/2674] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Oct 27 14:20:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:20:45.223339 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a31f04-7fba-46c3-a1e0-625b9ed7d9d0 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:45.235040 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a31f04-7fba-46c3-a1e0-625b9ed7d9d0 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:45.240003 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96586d8e-457b-49ba-aea3-89fde7fbf72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:45.240972 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96586d8e-457b-49ba-aea3-89fde7fbf72f admin admin] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:45.241871 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96586d8e-457b-49ba-aea3-89fde7fbf72f admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:45.242154 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96586d8e-457b-49ba-aea3-89fde7fbf72f admin admin] PATH_INFO: `/v3/projects` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:45.242828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96586d8e-457b-49ba-aea3-89fde7fbf72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:45.268709 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96586d8e-457b-49ba-aea3-89fde7fbf72f admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:45.296207 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1339/2675] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Oct 27 14:20:45 2021] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:20:45.300194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e93cfb-40dd-4847-8aea-02516f790ea8 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:45.310819 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e93cfb-40dd-4847-8aea-02516f790ea8 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:45.372889 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03834f-ee39-4975-b020-35ef4fdce5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:45.373493 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03834f-ee39-4975-b020-35ef4fdce5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:45.373784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03834f-ee39-4975-b020-35ef4fdce5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:45.374070 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03834f-ee39-4975-b020-35ef4fdce5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:45.374737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03834f-ee39-4975-b020-35ef4fdce5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:45.400637 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03834f-ee39-4975-b020-35ef4fdce5b2 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:45.423917 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1337/2676] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Oct 27 14:20:45 2021] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:20:45.428455 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96586d8e-457b-49ba-aea3-89fde7fbf72f admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:45.438870 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96586d8e-457b-49ba-aea3-89fde7fbf72f admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:45.443080 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4a4f3-8747-4608-99ad-79160ea71928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:45.443669 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4a4f3-8747-4608-99ad-79160ea71928 admin admin] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:45.443960 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4a4f3-8747-4608-99ad-79160ea71928 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:45.444415 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4a4f3-8747-4608-99ad-79160ea71928 admin admin] PATH_INFO: `/v3/roles` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:45.445192 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4a4f3-8747-4608-99ad-79160ea71928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:45.470414 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4a4f3-8747-4608-99ad-79160ea71928 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:45.483311 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1340/2677] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Oct 27 14:20:45 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:20:45.487752 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03834f-ee39-4975-b020-35ef4fdce5b2 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:45.497841 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03834f-ee39-4975-b020-35ef4fdce5b2 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:45.502351 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598b9d1-82f9-4823-bb93-0e4ca1bd2f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:45.503209 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598b9d1-82f9-4823-bb93-0e4ca1bd2f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:45.503501 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598b9d1-82f9-4823-bb93-0e4ca1bd2f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:45.503789 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598b9d1-82f9-4823-bb93-0e4ca1bd2f50 admin admin] PATH_INFO: `/v3/projects/00155e06d5cb4041a110d258628f9036/users/c90ec634c7c84957b11ea0c95ed3f1c3/roles/871d3e9701f04be1906b8ef20b10077b` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:45.532332 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598b9d1-82f9-4823-bb93-0e4ca1bd2f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00155e06d5cb4041a110d258628f9036, user_id=c90ec634c7c84957b11ea0c95ed3f1c3, role_id=871d3e9701f04be1906b8ef20b10077b)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:45.560136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598b9d1-82f9-4823-bb93-0e4ca1bd2f50 admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:45.572923 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1338/2678] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Oct 27 14:20:45 2021] PUT /identity/v3/projects/00155e06d5cb4041a110d258628f9036/users/c90ec634c7c84957b11ea0c95ed3f1c3/roles/871d3e9701f04be1906b8ef20b10077b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:20:45.577874 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1dce-150f-4897-a2cb-577f15deac9d None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:45.578168 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1dce-150f-4897-a2cb-577f15deac9d None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:45.578448 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1dce-150f-4897-a2cb-577f15deac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:45.601343 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-30af1dce-150f-4897-a2cb-577f15deac9d None None] MFA Rules not processed for user `35ed18ce25b9435aaf42d0a0ed7b1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:45.602783 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-30af1dce-150f-4897-a2cb-577f15deac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:45.666451 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1341/2679] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:45.676517 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598b9d1-82f9-4823-bb93-0e4ca1bd2f50 admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:45.678116 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7598b9d1-82f9-4823-bb93-0e4ca1bd2f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:45.752563 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598b9d1-82f9-4823-bb93-0e4ca1bd2f50 admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:45.758213 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6361a2-d842-4e5d-a583-fb940a56cefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:45.759261 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6361a2-d842-4e5d-a583-fb940a56cefc service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:45.759791 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6361a2-d842-4e5d-a583-fb940a56cefc service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:45.760304 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6361a2-d842-4e5d-a583-fb940a56cefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:45.770189 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6361a2-d842-4e5d-a583-fb940a56cefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:45.795863 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6361a2-d842-4e5d-a583-fb940a56cefc service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:45.806464 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1339/2680] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:20:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:20:46.762550 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4f06-911b-4395-b5ad-a634485e30ce None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:46.763163 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4f06-911b-4395-b5ad-a634485e30ce None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:46.763562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4f06-911b-4395-b5ad-a634485e30ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:46.802304 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-5a4a4f06-911b-4395-b5ad-a634485e30ce None None] MFA Rules not processed for user `c90ec634c7c84957b11ea0c95ed3f1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:46.803632 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-5a4a4f06-911b-4395-b5ad-a634485e30ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:46.885315 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1342/2681] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:46 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:20:46.894896 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6361a2-d842-4e5d-a583-fb940a56cefc service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:20:46.896297 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7f6361a2-d842-4e5d-a583-fb940a56cefc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:46.961682 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6361a2-d842-4e5d-a583-fb940a56cefc service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:20:46.965403 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff95cd-4f9d-4c5c-bb5d-4c6129d47797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c014f6c51ed4c99a1a4450dde18cbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:20:46.965990 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff95cd-4f9d-4c5c-bb5d-4c6129d47797 service cinder] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:46.966282 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff95cd-4f9d-4c5c-bb5d-4c6129d47797 service cinder] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:46.966561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff95cd-4f9d-4c5c-bb5d-4c6129d47797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:46.975232 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff95cd-4f9d-4c5c-bb5d-4c6129d47797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:20:47.011824 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff95cd-4f9d-4c5c-bb5d-4c6129d47797 service cinder] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:20:47.024870 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1340/2682] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:20:46 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:20:48.611576 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb48563-808d-483a-b812-fc0dfbedc2fd None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:20:48.612095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb48563-808d-483a-b812-fc0dfbedc2fd None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:20:48.612225 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb48563-808d-483a-b812-fc0dfbedc2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:20:48.634864 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-cfb48563-808d-483a-b812-fc0dfbedc2fd None None] MFA Rules not processed for user `c90ec634c7c84957b11ea0c95ed3f1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:20:48.636025 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cfb48563-808d-483a-b812-fc0dfbedc2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:20:48.642508 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1343/2683] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:20:48 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:21:32.340495 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff95cd-4f9d-4c5c-bb5d-4c6129d47797 service cinder] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:21:32.341940 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-05ff95cd-4f9d-4c5c-bb5d-4c6129d47797 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:21:32.354255 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff95cd-4f9d-4c5c-bb5d-4c6129d47797 service cinder] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:21:32.357566 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:21:32.358128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:21:32.358418 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:21:32.358737 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:21:32.360393 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:21:32.371705 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:21:32.397725 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:21:32.408522 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1341/2684] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:21:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:21:39.553924 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f5bc-82c4-4330-b2e6-cca8696dad3c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:21:39.554535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f5bc-82c4-4330-b2e6-cca8696dad3c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:21:39.554535 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f5bc-82c4-4330-b2e6-cca8696dad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:21:39.578341 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-9773f5bc-82c4-4330-b2e6-cca8696dad3c None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:21:39.579567 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9773f5bc-82c4-4330-b2e6-cca8696dad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:21:39.650732 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1344/2685] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:21:39 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:21:39.698561 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:21:39.699956 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:21:39.777366 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae47fa-6ccb-4c39-8713-44fc82097fde service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:21:39.782211 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f87df6-f866-43bc-869b-64e66d87fe9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:21:39.782833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f87df6-f866-43bc-869b-64e66d87fe9c service swift] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:21:39.783127 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f87df6-f866-43bc-869b-64e66d87fe9c service swift] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:21:39.783430 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f87df6-f866-43bc-869b-64e66d87fe9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:21:39.791624 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f87df6-f866-43bc-869b-64e66d87fe9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:21:39.817869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f87df6-f866-43bc-869b-64e66d87fe9c service swift] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:21:39.831770 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1342/2686] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:21:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:21:46.129630 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773f5bc-82c4-4330-b2e6-cca8696dad3c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:21:46.131068 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-9773f5bc-82c4-4330-b2e6-cca8696dad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:21:46.188287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773f5bc-82c4-4330-b2e6-cca8696dad3c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:21:46.195095 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:21:46.196366 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:21:46.196884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:21:46.197584 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] PATH_INFO: `/v3/users/41e0b26101294f8297066407a380c700` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:21:46.199205 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e0b26101294f8297066407a380c700)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:21:46.228950 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:21:46.304259 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e0b26101294f8297066407a380c700'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.316995 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e0b26101294f8297066407a380c700'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.317683 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e0b26101294f8297066407a380c700'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.325746 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e0b26101294f8297066407a380c700'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.335030 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e0b26101294f8297066407a380c700'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.341756 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1345/2687] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:21:46 2021] DELETE /identity/v3/users/41e0b26101294f8297066407a380c700 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:21:46.628128 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f87df6-f866-43bc-869b-64e66d87fe9c service swift] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:21:46.641280 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f87df6-f866-43bc-869b-64e66d87fe9c service swift] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:21:46.730833 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:21:46.731751 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:21:46.732157 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:21:46.732633 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] PATH_INFO: `/v3/projects/aaa8c6a1d9f04b8aa940a26076686eab` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:21:46.733790 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa8c6a1d9f04b8aa940a26076686eab)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:21:46.761687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:21:46.839272 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa8c6a1d9f04b8aa940a26076686eab', 'request_id': 'req-fad6a04b-75fa-4589-87d3-12624a77b06a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.852726 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa8c6a1d9f04b8aa940a26076686eab', 'request_id': 'req-fad6a04b-75fa-4589-87d3-12624a77b06a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.861825 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa8c6a1d9f04b8aa940a26076686eab', 'request_id': 'req-fad6a04b-75fa-4589-87d3-12624a77b06a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.873883 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] The token cache is being invalidate because project aaa8c6a1d9f04b8aa940a26076686eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:21:46.874518 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.877109 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:46.878388 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1343/2688] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:21:46 2021] DELETE /identity/v3/projects/aaa8c6a1d9f04b8aa940a26076686eab => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:21:46.882445 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:21:46.883953 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:21:46.897562 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d44e7-dab1-4686-8497-c78769cae92c admin admin] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:21:46.967172 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:21:46.968131 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:21:46.968538 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:21:46.968825 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] PATH_INFO: `/v3/users/155100cd4b03445182e947b6c6c3f741` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:21:46.969940 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155100cd4b03445182e947b6c6c3f741)` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:21:46.996407 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:21:47.064257 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155100cd4b03445182e947b6c6c3f741'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.077684 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155100cd4b03445182e947b6c6c3f741'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.078521 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155100cd4b03445182e947b6c6c3f741'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.086582 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155100cd4b03445182e947b6c6c3f741'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.098202 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.notifications [None req-617393d8-6f8d-4526-ab08-2a3001bc7cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155100cd4b03445182e947b6c6c3f741'} {{(pid=66092) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.110752 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1346/2689] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Oct 27 14:21:46 2021] DELETE /identity/v3/users/155100cd4b03445182e947b6c6c3f741 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:21:47.408928 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:21:47.411100 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:21:47.426293 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6a04b-75fa-4589-87d3-12624a77b06a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:21:47.506885 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ed18ce25b9435aaf42d0a0ed7b1a41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdb79eb1d18d4b408274e7d70cc19ee8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:21:47.507840 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:21:47.508045 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:21:47.508941 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] PATH_INFO: `/v3/projects/98dc11e3b2494b96a7e1e8a5d9a7b516` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:21:47.511103 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] RBAC: Authorizing `identity:delete_project(project_id=98dc11e3b2494b96a7e1e8a5d9a7b516)` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:21:47.538829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:21:47.604224 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98dc11e3b2494b96a7e1e8a5d9a7b516', 'request_id': 'req-adca693c-a572-4508-9ab7-05ca292bf92a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.619907 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98dc11e3b2494b96a7e1e8a5d9a7b516', 'request_id': 'req-adca693c-a572-4508-9ab7-05ca292bf92a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.631107 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98dc11e3b2494b96a7e1e8a5d9a7b516', 'request_id': 'req-adca693c-a572-4508-9ab7-05ca292bf92a'} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.648544 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] The token cache is being invalidate because project 98dc11e3b2494b96a7e1e8a5d9a7b516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66091) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 14:21:47.649533 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.650358 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.notifications [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66091) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 14:21:47.652194 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1344/2690] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Oct 27 14:21:47 2021] DELETE /identity/v3/projects/98dc11e3b2494b96a7e1e8a5d9a7b516 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:22:00.323576 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdb33d-b418-4183-a68a-f42946146e53 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:00.324076 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdb33d-b418-4183-a68a-f42946146e53 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:00.324287 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdb33d-b418-4183-a68a-f42946146e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:00.352689 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-92bdb33d-b418-4183-a68a-f42946146e53 None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:22:00.353851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-92bdb33d-b418-4183-a68a-f42946146e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:00.416682 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1347/2691] 10.222.0.36 () {58 vars in 1014 bytes} [Wed Oct 27 14:22:00 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:22:00.428440 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:22:00.429838 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:00.504514 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca693c-a572-4508-9ab7-05ca292bf92a admin admin] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:22:00.509004 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef17308-4708-4173-ae13-c746d744bf59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:22:00.509587 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17308-4708-4173-ae13-c746d744bf59 service swift] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:00.509881 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17308-4708-4173-ae13-c746d744bf59 service swift] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:00.510158 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17308-4708-4173-ae13-c746d744bf59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:00.518796 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef17308-4708-4173-ae13-c746d744bf59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:22:00.544056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef17308-4708-4173-ae13-c746d744bf59 service swift] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:22:00.552325 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1345/2692] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:22:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:22:04.546959 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e58b-044a-4592-bd1a-fa706344a52c None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:04.547749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e58b-044a-4592-bd1a-fa706344a52c None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:04.547749 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e58b-044a-4592-bd1a-fa706344a52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:04.569884 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-fb44e58b-044a-4592-bd1a-fa706344a52c None None] MFA Rules not processed for user `c90ec634c7c84957b11ea0c95ed3f1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:22:04.571144 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fb44e58b-044a-4592-bd1a-fa706344a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:04.640470 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1348/2693] 10.222.0.36 () {58 vars in 957 bytes} [Wed Oct 27 14:22:04 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:22:04.658834 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef17308-4708-4173-ae13-c746d744bf59 service swift] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:22:04.660203 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-0ef17308-4708-4173-ae13-c746d744bf59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:04.731433 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef17308-4708-4173-ae13-c746d744bf59 service swift] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:22:04.735102 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:22:04.735699 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:04.735986 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:04.736268 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:04.738086 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:04.825198 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:22:04.851807 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:22:04.863269 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1346/2694] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:22:04 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:22:04.944818 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44e58b-044a-4592-bd1a-fa706344a52c None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:22:04.955350 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44e58b-044a-4592-bd1a-fa706344a52c None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:22:04.959768 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:22:04.960354 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:04.961148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:04.961148 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:04.975531 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:04.989429 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:22:05.015263 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:22:05.040150 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1349/2695] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:22:04 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:22:05.558099 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:22:05.559608 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:05.659480 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988eb99-6373-4ea3-ad86-7de2448bfd52 service neutron] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:22:05.664153 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d45160-6d4b-4ba5-882c-355154ceab6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:22:05.664803 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45160-6d4b-4ba5-882c-355154ceab6c service placement] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:05.665056 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45160-6d4b-4ba5-882c-355154ceab6c service placement] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:05.665315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45160-6d4b-4ba5-882c-355154ceab6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:05.667034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a7d45160-6d4b-4ba5-882c-355154ceab6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:05.678315 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d45160-6d4b-4ba5-882c-355154ceab6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:22:05.704784 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d45160-6d4b-4ba5-882c-355154ceab6c service placement] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:22:05.717136 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1347/2696] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:22:05 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:22:05.825723 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:22:05.827266 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:05.841695 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7a752-b6ce-49b8-a2ab-0b8122aa9161 service neutron] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:22:05.846829 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:22:05.847417 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:05.847711 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:05.847997 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:05.849712 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:05.861248 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:22:05.887861 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:22:05.899733 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1350/2697] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:22:05 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:22:06.107034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d45160-6d4b-4ba5-882c-355154ceab6c service placement] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:22:06.124616 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d45160-6d4b-4ba5-882c-355154ceab6c service placement] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:22:06.131977 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090e7c-5aae-4228-912b-6676fbadfab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:22:06.132702 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090e7c-5aae-4228-912b-6676fbadfab1 service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:06.133072 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090e7c-5aae-4228-912b-6676fbadfab1 service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:06.133352 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090e7c-5aae-4228-912b-6676fbadfab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:06.135379 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-a8090e7c-5aae-4228-912b-6676fbadfab1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:06.215367 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8090e7c-5aae-4228-912b-6676fbadfab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:22:06.241621 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8090e7c-5aae-4228-912b-6676fbadfab1 service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:22:06.252032 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1348/2698] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:22:06 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:22:14.293498 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:22:14.294877 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:14.306867 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76272-a082-4b39-8ce2-d92a09721eb6 service placement] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:22:14.310839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b875f-7766-40b2-921e-079412bb6154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea5ec2125f0468baa1e15a429021e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:22:14.310839 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b875f-7766-40b2-921e-079412bb6154 service neutron] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:14.311100 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b875f-7766-40b2-921e-079412bb6154 service neutron] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:14.311389 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b875f-7766-40b2-921e-079412bb6154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:14.313509 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-647b875f-7766-40b2-921e-079412bb6154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:14.326575 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b875f-7766-40b2-921e-079412bb6154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:22:14.353096 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b875f-7766-40b2-921e-079412bb6154 service neutron] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:22:14.361851 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1351/2699] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:22:14 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:22:15.359739 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090e7c-5aae-4228-912b-6676fbadfab1 service nova] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:22:15.370728 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090e7c-5aae-4228-912b-6676fbadfab1 service nova] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:22:15.375908 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1963-84ba-4a22-9b83-6c72127c2cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a523c35d222f464e9d4f78ae990e3a17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:22:15.376560 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1963-84ba-4a22-9b83-6c72127c2cea service nova] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:15.377410 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1963-84ba-4a22-9b83-6c72127c2cea service nova] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:15.377687 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa1963-84ba-4a22-9b83-6c72127c2cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:15.379378 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.fernet_utils [None req-29aa1963-84ba-4a22-9b83-6c72127c2cea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66091) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:15.393259 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa1963-84ba-4a22-9b83-6c72127c2cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:22:15.418952 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa1963-84ba-4a22-9b83-6c72127c2cea service nova] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:22:15.429829 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1349/2700] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:22:15 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:22:19.618327 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9681c7-353d-4d9a-b956-0ffb8aee4c92 None None] REQUEST_METHOD: `POST` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:19.618828 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9681c7-353d-4d9a-b956-0ffb8aee4c92 None None] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:19.618929 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9681c7-353d-4d9a-b956-0ffb8aee4c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:19.641801 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.auth.core [None req-7e9681c7-353d-4d9a-b956-0ffb8aee4c92 None None] MFA Rules not processed for user `4ecd9bf5e6f04ca5a246bcfb7200e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=66092) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:22:19.643048 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-7e9681c7-353d-4d9a-b956-0ffb8aee4c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:22:19.649476 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1352/2701] 10.222.0.36 () {58 vars in 967 bytes} [Wed Oct 27 14:22:19 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:22:19.661527 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1963-84ba-4a22-9b83-6c72127c2cea service nova] Authenticating user token {{(pid=66091) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:22:19.672596 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa1963-84ba-4a22-9b83-6c72127c2cea service nova] Validating token access rules against request {{(pid=66091) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:22:19.677749 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66daef6-d577-47ed-8cd8-9617e3ac42bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56f87a3cc4c4503a156700b66525530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66091) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:22:19.678328 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66daef6-d577-47ed-8cd8-9617e3ac42bd service swift] REQUEST_METHOD: `GET` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:22:19.678658 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66daef6-d577-47ed-8cd8-9617e3ac42bd service swift] SCRIPT_NAME: `/identity` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:22:19.678939 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66daef6-d577-47ed-8cd8-9617e3ac42bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66091) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:22:19.686960 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66daef6-d577-47ed-8cd8-9617e3ac42bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:22:19.712869 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66daef6-d577-47ed-8cd8-9617e3ac42bd service swift] RBAC: Authorization granted {{(pid=66091) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:22:19.721034 dv-cinder-815663-1-iscsi devstack@keystone.service[66091]: [pid: 66091|app: 0|req: 1350/2702] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Oct 27 14:22:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 14:24:54.455832 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9681c7-353d-4d9a-b956-0ffb8aee4c92 None None] Authenticating user token {{(pid=66092) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:24:54.521431 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9681c7-353d-4d9a-b956-0ffb8aee4c92 None None] Validating token access rules against request {{(pid=66092) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:24:54.526098 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04136ada-f845-47f8-886c-06f9a53729d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78404f52618b4d86a2a478f18b136773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd358f713924c24991a83b329dfcb8e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66092) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:24:54.526740 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04136ada-f845-47f8-886c-06f9a53729d6 service placement] REQUEST_METHOD: `GET` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:24:54.527033 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04136ada-f845-47f8-886c-06f9a53729d6 service placement] SCRIPT_NAME: `/identity` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:24:54.527316 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04136ada-f845-47f8-886c-06f9a53729d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66092) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:24:54.529012 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.fernet_utils [None req-04136ada-f845-47f8-886c-06f9a53729d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66092) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:24:54.567996 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04136ada-f845-47f8-886c-06f9a53729d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:24:54.594005 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04136ada-f845-47f8-886c-06f9a53729d6 service placement] RBAC: Authorization granted {{(pid=66092) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:24:54.604734 dv-cinder-815663-1-iscsi devstack@keystone.service[66092]: [pid: 66092|app: 0|req: 1353/2703] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Oct 27 14:24:54 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)